Mixed-Integer Programming for Adaptive VR Workflow Training

Published

June 29, 2024

Author(s)

Simon Su

Abstract

With advances in consumer-grade virtual reality (VR) devices, VR training gains unprecedented attention in research and industries. Although the nature of VR training encourages trainees to actively learn through exploring and gathering information in a simulated virtual environment, designing effective virtual training environments is non-trivial. We propose an adaptive approach that guides trainees to develop psychomotor skills in a simulated virtual environment. As a showcase, we demonstrate our novel approach for restaurant service training. By incorporating the trainee's performance and learning progress into optimization objectives, our approach uses mixed integer programming (MIP) to generate VR training sessions iteratively. Through collecting the trainee's performance in VR training, our approach adapts the VR training sessions by considering the trainee's strengths and weaknesses, guiding the trainee to improve over training sessions. We validate our approach through two experimental studies. In the first study, we compared our approach with a random training task assignment approach and a performance-only MIP approach through performing simulated restaurant service training. In the second study, we compared our approach with the random assignment approach by evaluating trainees' skill developments in restaurant services. The results show that our skill-driven adaptive training approach outperforms the random assignment approach.

Proceedings Title

Virtual, Augmented and Mixed Reality: 16th International Conference, VAMR 2024, Held as Part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29 – July 4, 2024, Proceedings, Part III

Conference Dates

June 29-July 4, 2024

Conference Location

Washington DC, DC, US

Pub Type

Conferences

Download Paper

Local Download

Keywords

Virtual Reality Training, Adaptive Training Approach

Citation

Su, S. (2024), Mixed-Integer Programming for Adaptive VR Workflow Training, Virtual, Augmented and Mixed Reality: 16th International Conference, VAMR 2024, Held as Part of the 26th HCI International Conference, HCII 2024, Washington, DC, USA, June 29 – July 4, 2024, Proceedings, Part III, Washington DC, DC, US, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=936350 (Accessed October 6, 2026)

Additional citation formats