MSc Serious Games & Virtual Reality School of Innovation & Technology

Gen Yue

This project explores the integration of audio-driven haptic feedback into a VR serious game designed around Bianzhong, an ancient Chinese chime bell instrument with over two thousand years of history and inscribed on the UNESCO Memory of the World Register. The aim of the project is to investigate whether haptic feedback synchronized with audio can enhance user immersion and cultural understanding in virtual heritage experiences.

🔹 Project Overview Developed in Unity with two main scenes: Intro Scene – presenting cultural background of the Bianzhong Main Scene – interactive VR bell-playing experience with real-time haptic feedback Core mechanism: mapping audio events to vibration intensity and patterns, providing a multisensory experience.

🔹 Evaluation and Results Participants: 12, divided into two groups (Haptic First vs. Haptic Second). Methods: gameplay observation, questionnaire (immersion scale), cultural knowledge test, and interviews. Results showed that the haptic condition improved immersion scores, cultural knowledge retention, and user engagement compared to the non-haptic condition.

🔹 Contributions Applied audio-driven haptic feedback to cultural heritage VR experiences. Proposed a reusable vibration design framework for serious games. Provided initial empirical evidence (N=12) of the positive effects of haptics on immersion and cultural learning outcomes.

🔹 Limitations & Future Work Small sample size and limited vibration intensity of Quest 3 hardware. Future work will involve larger-scale user studies, more diverse cultural heritage contexts, and integration with advanced haptic devices such as gloves or wearables.

✨ This video was created for the Postgraduate Showcase 2025. It includes an introduction to the project, a summary of the system design, evaluation methods, results, and an overview of outcomes.

Contact
yuegen1@outlook.com
G.Yue1@student.gsa.ac.uk
youtu.be
Works
Immersive Cultural Heritage Experience: Design and Evaluation of a VR Serious Game for Bianzhong

4cfce3966f1b6de508cb24a07143c378

Audio-Driven Haptic Feedback in VR Cultural Heritage

BG-1

VR Audio-Driven Haptic

BG-2

post

Immersive Cultural Heritage Experience: Design and Evaluation of a VR Serious Game for Bianzhong

This project explores the integration of audio-driven haptic feedback into a VR serious game designed around Bianzhong, an ancient Chinese chime bell instrument with over two thousand years of history and inscribed on the UNESCO Memory of the World Register. The aim of the project is to investigate whether haptic feedback synchronized with audio can enhance user immersion and cultural understanding in virtual heritage experiences.

🔹 Project Overview Developed in Unity with two main scenes: Intro Scene – presenting cultural background of the Bianzhong Main Scene – interactive VR bell-playing experience with real-time haptic feedback Core mechanism: mapping audio events to vibration intensity and patterns, providing a multisensory experience.

🔹 Evaluation and Results Participants: 12, divided into two groups (Haptic First vs. Haptic Second). Methods: gameplay observation, questionnaire (immersion scale), cultural knowledge test, and interviews. Results showed that the haptic condition improved immersion scores, cultural knowledge retention, and user engagement compared to the non-haptic condition.

🔹 Contributions Applied audio-driven haptic feedback to cultural heritage VR experiences. Proposed a reusable vibration design framework for serious games. Provided initial empirical evidence (N=12) of the positive effects of haptics on immersion and cultural learning outcomes.

🔹 Limitations & Future Work Small sample size and limited vibration intensity of Quest 3 hardware. Future work will involve larger-scale user studies, more diverse cultural heritage contexts, and integration with advanced haptic devices such as gloves or wearables.

✨ This video was created for the Postgraduate Showcase 2025. It includes an introduction to the project, a summary of the system design, evaluation methods, results, and an overview of outcomes.

bianzhong image

Audio-Driven Haptic Feedback in VR Cultural Heritage

BG-1

VR Audio-Driven Haptic