Haptic Mixed-Reality Simulation with Competency-Gated Scaffolds for Heavy-Equipment Training
DOI:
https://doi.org/10.63646/GYPP8788Keywords:
Heavy Equipment, Mixed Reality, Haptic Feedback, Competency-Based Education, Instructional Scaffolding, Simulator TrainingAbstract
This article specifies a haptic mixed-reality training architecture for heavy-equipment education in which competency evidence governs both task progression and the fading of instructional support. The design addresses a persistent instructional problem: novice operators must coordinate control inputs, machine response, terrain, load, visibility, and safety procedures, while opportunities for repeated practice on actual equipment are limited and consequential errors are unacceptable. The proposed system combines an equipment-specific digital model, mixed-reality scene, instrumented control station, bounded force and vibrotactile rendering, an instructor console, and a transparent competency engine. It separates high-rate local haptic rendering from slower scene updates and network services; it does not connect a learner’s remote command directly to live heavy machinery. Learning tasks progress from control familiarization to coordinated operations and variable scenarios. Scaffolds provide demonstrations, prompts, overlays, and feedback, then fade only when repeated evidence indicates stable, safe performance and learner explanation. A non-compensatory safety gate prevents strong scores on speed or smoothness from offsetting a critical safety failure. The article defines system components, data contracts, task and assessment models, an excavator walkthrough, accessibility and governance safeguards, and a staged verification plan. The scenario and acceptance criteria are design artifacts; no prototype evaluation or empirical learning effect is claimed.How to Cite
References
Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2), 89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42. https://doi.org/10.3102/0013189X018001032
Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive apprenticeship: Teaching the crafts of reading, writing, and mathematics. In L. B. Resnick (Ed.), Knowing, learning, and instruction (pp. 453–494). Lawrence Erlbaum Associates. https://doi.org/10.4324/9781315044408-14
Reiser, B. J. (2004). Scaffolding complex learning: The mechanisms of structuring and problematizing student work. The Journal of the Learning Sciences, 13(3), 273–304. https://doi.org/10.1207/s15327809jls1303_2
van Merriënboer, J. J. G., & Kirschner, P. A. (2018). Ten steps to complex learning: A systematic approach to four-component instructional design (3rd ed.). Routledge. https://doi.org/10.4324/9781315113210
Bloom, B. S. (1968). Learning for mastery. Evaluation Comment, 1(2), 1–12.
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363–406. https://doi.org/10.1037/0033-295X.100.3.363
Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Wulf, G., & Prinz, W. (2001). Directing attention to movement effects enhances learning: A review. Psychonomic Bulletin & Review, 8(4), 648–660. https://doi.org/10.3758/BF03196201
Barnett, S. M., & Ceci, S. J. (2002). When and where do we apply what we learn? A taxonomy for far transfer. Psychological Bulletin, 128(4), 612–637. https://doi.org/10.1037/0033-2909.128.4.612
Hamstra, S. J., Brydges, R., Hatala, R., Zendejas, B., & Cook, D. A. (2014). Reconsidering fidelity in simulation-based training. Academic Medicine, 89(3), 387–392. https://doi.org/10.1097/ACM.0000000000000130
Su, X., Dunston, P. S., Proctor, R. W., & Wang, X. (2013). Influence of training schedule on development of perceptual–motor control skills for construction equipment operators in a virtual training system. Automation in Construction, 35, 439–447. https://doi.org/10.1016/j.autcon.2013.05.029
So, J. C. Y., Macrowski, L. M., Dunston, P. S., Proctor, R. W., & Goodney, J. E. (2016). Transfer of operator training from simulated to real hydraulic excavators. In Construction Research Congress 2016 (pp. 1968–1977). American Society of Civil Engineers. https://doi.org/10.1061/9780784479827.196
Louis, J., Luth, C., & Cairns, R. (2020). Mixed reality-based equipment simulator for construction operations. In Construction Research Congress 2020 (pp. 649–658). American Society of Civil Engineers. https://doi.org/10.1061/9780784482865.069
Vahdatikhaki, F., El Ammari, K., Langroodi, A. K., Miller, S., Hammad, A., & Dorée, A. (2019). Beyond data visualization: A context-realistic construction equipment training simulators. Automation in Construction, 106, 102853. https://doi.org/10.1016/j.autcon.2019.102853
Vahdatikhaki, F., Langroodi, A. K., Scholtenhuis, L. O., & Dorée, A. (2022). Feedback support system for training of excavator operators. Automation in Construction, 136, 104188. https://doi.org/10.1016/j.autcon.2022.104188
Warren, A. D., Proctor, R. W., & Dunston, P. S. (2023). Effect of motion feedback on skill acquisition: Training performance using an excavator simulator. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 67(1), 1329–1330. https://doi.org/10.1177/21695067231192701
Colgate, J. E., & Brown, J. M. (1994). Factors affecting the Z-width of a haptic display. In Proceedings of the 1994 IEEE International Conference on Robotics and Automation (pp. 3205–3210). IEEE. https://doi.org/10.1109/ROBOT.1994.351077
Adams, R. J., & Hannaford, B. (1999). Stable haptic interaction with virtual environments. IEEE Transactions on Robotics and Automation, 15(3), 465–474. https://doi.org/10.1109/70.768179
Hannaford, B., & Ryu, J.-H. (2002). Time-domain passivity control of haptic interfaces. IEEE Transactions on Robotics and Automation, 18(1), 1–10. https://doi.org/10.1109/70.988969
Salisbury, K., Conti, F., & Barbagli, F. (2004). Haptic rendering: Introductory concepts. IEEE Computer Graphics and Applications, 24(2), 24–32. https://doi.org/10.1109/MCG.2004.1274058
Hayward, V., Astley, O. R., Cruz-Hernandez, M., Grant, D., & Robles-De-La-Torre, G. (2004). Haptic interfaces and devices. Sensor Review, 24(1), 16–29. https://doi.org/10.1108/02602280410515770
Okamura, A. M. (2009). Haptic feedback in robot-assisted minimally invasive surgery. Current Opinion in Urology, 19(1), 102–107. https://doi.org/10.1097/MOU.0b013e32831a478c
So, J. C. Y., Proctor, R. W., Dunston, P. S., & Wang, X. (2013). Better retention of skill operating a simulated hydraulic excavator after part-task than after whole-task training. Human Factors, 55(3), 449–460. https://doi.org/10.1177/0018720812454292
International Organization for Standardization. (2019). ISO 9241-210:2019: Ergonomics of human-system interaction—Part 210: Human-centred design for interactive systems. ISO. https://doi.org/10.3403/30388991
International Organization for Standardization. (2024). ISO 9241-820:2024: Ergonomics of human-system interaction—Part 820: Ergonomic guidance on interactions in immersive environments, including augmented reality and virtual reality. ISO. https://doi.org/10.3403/30456850
International Organization for Standardization. (2020). ISO 9241-971:2020: Ergonomics of human-system interaction—Part 971: Accessibility of tactile/haptic interactive systems. ISO.
Khronos Group. (2024). The OpenXR 1.1 specification. Khronos Group.
International Organization for Standardization & International Electrotechnical Commission. (2024). ISO/IEC 5927:2024: Information technology—Computer graphics, image processing and environmental data representation—Augmented and virtual reality safety—Guidance on safe immersion, set up and usage. ISO. https://doi.org/10.3403/30433826u
International Organization for Standardization. (2010). ISO 12100:2010: Safety of machinery—General principles for design—Risk assessment and risk reduction. ISO. https://www.iso.org/standard/51528.html
International Organization for Standardization. (2023). ISO 13849-1:2023: Safety of machinery—Safety-related parts of control systems—Part 1: General principles for design. ISO.
International Organization for Standardization. (2015). ISO 13850:2015: Safety of machinery—Emergency stop function—Principles for design. ISO. https://doi.org/10.3403/30265059
International Organization for Standardization & International Electrotechnical Commission. (2020). ISO/IEC TR 23842-1:2020: Information technology for learning, education and training—Human factor guidelines for virtual reality content—Part 1: Considerations when using VR content. ISO. https://doi.org/10.3403/30386739
Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press.
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
Chi, M. T. H., de Leeuw, N., Chiu, M.-H., & LaVancher, C. (1994). Eliciting self-explanations improves understanding. Cognitive Science, 18(3), 439–477. https://doi.org/10.1207/s15516709cog1803_3
National Research Council. (2000). How people learn: Brain, mind, experience, and school (Expanded ed.). National Academies Press. https://doi.org/10.17226/9853
Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1), 32–64. https://doi.org/10.1518/001872095779049543
Cook, D. A., Hamstra, S. J., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hatala, R. (2013). Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis. Medical Teacher, 35(1), e867–e898. https://doi.org/10.3109/0142159X.2012.714886
Norman, G., Dore, K., & Grierson, L. (2012). The minimal relationship between simulation fidelity and transfer of learning. Medical Education, 46(7), 636–647. https://doi.org/10.1111/j.1365-2923.2012.04243.x
Choi, S., & Kuchenbecker, K. J. (2013). Vibrotactile display: Perception, technology, and applications. Proceedings of the IEEE, 101(9), 2093–2104. https://doi.org/10.1109/JPROC.2012.2221071
International Organization for Standardization. (2018). ISO 45001:2018: Occupational health and safety management systems—Requirements with guidance for use. ISO.
International Electrotechnical Commission. (2016). IEC 60204-1:2016: Safety of machinery—Electrical equipment of machines—Part 1: General requirements. IEC.
CAST. (2024). Universal design for learning guidelines version 3.0. CAST.







