Skip to main navigation Skip to search Skip to main content

Developing an Immersive Augmented Reality-Based Coffee-Making Skills Training System for Individuals with Intellectual Disabilities

  • Ting Fang Wu*
  • , Hui Shan Lo
  • , Tien Chi Huang
  • , Jon Chao Hong
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This study presents the development of an Immersive Augmented Reality-Based Coffee-Making Training System, designed to enhance vocational training for individuals with intellectual disabilities (ID). Grounded in scaffolding theory, the system integrates immersive technology, gamification, and a multi-level prompting mechanism to facilitate structured skill acquisition. The system features two training modes - practice mode and test mode-allowing learners to develop coffee-making skills through progressive learning and real-time feedback. The practice mode includes two training methods: a Target Challenge Competition, which emphasizes precision and speed, and a Speed Coffee Competition, which focuses on efficiency under time constraints. The test mode enables learners to independently complete tasks without system-generated prompts, assessing their ability to transfer learned skills. The system utilizes Microsoft HoloLens 2, Unity, and Vuforia to provide a highly interactive and realistic training experience. This iAR-based training system addresses limitations of traditional vocational training, such as high costs, safety risks, and location constraints, by offering a scalable and adaptable solution. Its gamification elements, such as scoring and ranking, further enhance motivation and engagement. The study suggests that integrating iAR technology into vocational education can improve skill acquisition, task accuracy, and workplace readiness for individuals with ID. Future research will focus on evaluating the system's long-term effectiveness and exploring enhancements such as AI-driven adaptive learning, real-time analytics, and haptic feedback.

Original languageEnglish
Title of host publicationICEMT 2025 - 2025 9th International Conference on Education and Multimedia Technology
PublisherAssociation for Computing Machinery, Inc
Pages37-43
Number of pages7
ISBN (Electronic)9798400719387
DOIs
Publication statusPublished - 2026 Mar 16
Event9th International Conference on Education and Multimedia Technology, ICEMT 2025 - Osaka, Japan
Duration: 2025 Jul 292025 Aug 1

Publication series

NameICEMT 2025 - 2025 9th International Conference on Education and Multimedia Technology

Conference

Conference9th International Conference on Education and Multimedia Technology, ICEMT 2025
Country/TerritoryJapan
CityOsaka
Period2025/07/292025/08/01

Keywords

  • Immersive Augmented Reality
  • Individuals with Intellectual Disabilities
  • Scaffolding Theory
  • Vocational Skills Training

ASJC Scopus subject areas

  • Education
  • Human-Computer Interaction
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Developing an Immersive Augmented Reality-Based Coffee-Making Skills Training System for Individuals with Intellectual Disabilities'. Together they form a unique fingerprint.

Cite this