Search

Construction and Intelligent Evaluation of a Virtual Simulation Teaching System for Applied Undergraduate Education Based on Multimodal Interaction

Author(s)

Xin Zhang, Kaimei Li, Linshu Zhang

Affiliation(s)

Chongqing Polytechnic University of Electronic Technology, Chongqing, China

Abstract

In response to the core challenges in virtual simulation teaching within applied undergraduate education-such as fragmented resources and lagging evaluation mechanisms-this study constructs a tri-dimensional integrated virtual simulation teaching system featuring a knowledge graph, diversified interactions, and dynamic evaluation. An innovative multimodal interaction-based simulation evaluation platform is proposed to interconnect simulation operation data with learning behavior data, enabling a deep integration between the teaching process and evaluation mechanisms. By building a three-dimensional goal-oriented knowledge graph, developing multimodal simulation tasks covering sensor cognition, assembly and debugging, and programming, and embedding a dynamic evaluation model based on Pearson correlation and multiple regression, the system can track students’ operation paths and cognitive development in real time. Empirical research shows that this system significantly improves teaching quality and learning outcomes, providing a replicable practical solution for the digital transformation of applied undergraduate education.

Keywords

Virtual Simulation Teaching; Knowledge Graph; Multimodal Interaction; Intelligent Evaluation

References

[1] Chai Ruishuai. Research on the Evolution Logic and Mechanism of Digital-Intelligent Talent Training in Higher Vocational Colleges. Journal of Jiyuan Vocational and Technical College, 2025, 24(02): 22–26. DOI: CNKI:SUN:JYZB.0.2025-02-005. [2] Lei Shijie. Research on Teaching and Evaluation Reform of the Course “Fundamentals of Programming” Based on a Virtual Simulation Platform. Office Automation, 2025, 30(03): 44–46. DOI: CNKI:SUN:BGDH.0.2025-03-014. [3] Yu Renqiang, Zhang Zhiwei, Lü Fajin. Instructional Design and Effect Evaluation of Virtual Simulation Teaching in Medical Courses. Continuing Medical Education, 2024, 38(11): 147–150. DOI: CNKI:SUN:JYJY.0.2024-11-037. [4] Xiao Zhetao, Li Long, Liu Jianjun. Construction and Practice of a Virtual Simulation Teaching Evaluation System in the Digital Era. Digital Communication World, 2025(01): 205–207+210. DOI: CNKI:SUN:SZTJ.0.2025-01-060. [5] Wang Hao. Research on the Virtual Simulation Experimental Teaching Evaluation System for Road and Bridge Engineering Construction Courses. Industry & Technology Forum, 2019, 18(09): 196–197. DOI: CNKI:SUN:CYYT.0.2019-09-105. [6] Guo Wanqian, Guo Liang, Lin Nan, et al. Research on Virtual Simulation Experimental Teaching Evaluation Under the Background of Emerging Engineering Education—A Case Study of Environmental Science and Engineering. China Modern Educational Equipment, 2022(13): 1–4. DOI: 10.13492/j.cnki.cmee.2022.13.027. [7] Han Yueqiang. Research on Data Analysis and Teaching Evaluation of Virtual Simulation Experimental Teaching. Beijing University of Posts and Telecommunications, 2016. [8] Phillips, A., Pane, J. F., Reumann-Moore, R., & Shenbanjo, O. (2020). Implementing an adaptive intelligent tutoring system as an instructional supplement. Educational Technology Research and Development, 68(3), 1409–1437. [9] Wang Jianxin, Deng Haodong, Xiao Chao’en, et al. Hardware Trojan Detection Method Combining Multi-Bypass Analysis and Pearson Correlation Coefficient. Information Security Research, 2025, 11(05): 420–426. DOI: CNKI:SUN:XAQY.0.2025-05-004. [10] Sun Shoupeng. Research on Teaching Reform in Higher Vocational Colleges Based on Virtual Simulation Technology. Standards & Quality, 2022(7): 154–156. [11] Zhang Chi, Liu Shuying. Research on the Development of a Virtual Simulation Training Platform for Preschool Education in the Era of Integrated Publishing. China Media Technology, 2022(3): 7–10. [12] Wang Ze, Hua Wei, Guo Jinda. Construction of a Virtual Simulation Teaching Evaluation System for Secondary Vocational Nursing Based on the CIPP Model. Education Observation, 2025, 14(03): 54–57+74. DOI: 10.16070/j.cnki.cn45-1388/g4s.2025.03.022.