This study explores the research gap in the audio preservation of traditional Chinese Jin opera through the application of immersive interactive technology. Despite the adaptation of new performance and music styles in conventional Chinese opera, the use of multi-channel immersive technology for audio preservation remains unaddressed. This research investigates how such technology can enhance preservation methods and maintain audience engagement with traditional opera. Utilizing a dynamic microphone recording method with multiple stereo microphones, and creating an AR program via Unity, the study enables audience interaction with the music using mobile devices. Additional interactive tools like Kinect 2, Max/Msp, Logic Pro, and Protools will also be employed. The research introduces the Cognitive Theory of Multimedia Learning (CTML) and acoustic ecology (AC) to merge audience perception with musical expression, supporting the generation and transmission of traditional drama. This approach clearly differentiates between immersive interactive music and static music forms, providing a framework for innovative sound preservation in Jin opera theatre. The study cites various immersive interactive music productions to illustrate the dynamic microphone music production methods proposed.
Bao, F., Razi, S. a. B. H. M., & Yasin, M. A. I. B. (2023). A Case Study on the Transformation of Chinese Opera Radio under the Ecological Environment of Media Integration. Studies in Media and Communication, 12(1), 124. https://doi.org/10.11114/smc.v12i1.6472
Bec, A., Moyle, B., Timms, K., Schaffer, V., Skavronskaya, L., & Little, C. (2019). Management of immersive heritage tourism experiences: A conceptual model. Tourism Management, 72, 117–120. https://doi.org/10.1016/j.tourman.2018.10.033
Canazza, S. (2012). The digital curation of ethnic music audio archives: From preservation to restoration: Preserving a multicultural society. International Journal on Digital Libraries, 12, 121-135.
Colamatteo, A., Sansone, M., Pagnanelli, M. A., & Bruni, R. (2024). The role of immersive technologies in cultural contexts: future challenges from the literature. Italian Journal of Marketing, 2024(1), 113–142. https://doi.org/10.1007/s43039-024-00089-4 Commission on Preservation and Access.
Edström, E. (2023, March 19). Moving forward: An essay on how to contemporize the traditional Chinese theater without severing the tradition. Critical Stages/Scènes critiques. https://www.critical-stages.org/18/moving-forward-an-essay-on-how-to-contemporize-the-traditional-chinese-theater-without-severing-the-tradition/ Enhancing museum visitor experiences through immersive technologies - draw & code. (2023, October 22). Draw and Code. https://drawandcode.com/learning-zone/enhancing-museum-visitor-experiences-through-immersive-technologies/
Fan, Z., Chen, C., & Huang, H. (2022). Immersive cultural heritage digital documentation and information service for historical figure metaverse: a case of Zhu Xi, Song Dynasty, China. Heritage Science, 10(1). https://doi.org/10.1186/s40494-022-00749-8
Garlandini, A. (2021). MUSEUMS AND HERITAGE IN THE DIGITAL AGE. THE CHALLENGE OF CULTURAL CHANGE AND TECHNOLOGICAL INNOVATION. SCIRES-IT, 11(1), 11–18. https://doi.org/10.2423/i22394303v11n1p11
Han, P., Chen, Y., Liu, I., Jang, Y., Tsai, L., Chang, A., & Hung, Y. (2020). A compelling virtual tour of the Dunhuang Cave with an immersive Head-Mounted display. IEEE Computer Graphics and Applications, 40(1), 40–55. https://doi.org/10.1109/mcg.2019.2936753
Hong, X., & Wu, Y. (2021). The use of AR to preserve and popularize traditional Chinese musical instruments as part of the formation of the tourist attractiveness of the national art of Guizhou province. Digital Scholarship in the Humanities, 37(2), 426–440. https://doi.org/10.1093/llc/fqab087
Ibi?, A., & Alp, N. Ç. (2023). Augmented Reality Used in Cultural Heritage: a Systematic Review. Research Square (Research Square). https://doi.org/10.21203/rs.3.rs-2482925/v1
Innocente, C., Ulrich, L., Moos, S., & Vezzetti, E. (2023). A framework study on the use of immersive XR technologies in the cultural heritage domain. Journal of Cultural Heritage, 62, 268–283. https://doi.org/10.1016/j.culher.2023.06.001
Isa, W. M. W., Zin, N. a. M., Rosdi, F., & Sarim, H. M. (2018). Digital preservation of intangible cultural heritage. Indonesian Journal of Electrical Engineering and Computer Science, 12(3), 1373. https://doi.org/10.11591/ijeecs.v12.i3.pp1373-1379
Lan, L. (2021). Analysis on the development strategy of traditional Chinese opera based on digital media technology. Arts Studies and Criticism, 2(4). https://doi.org/10.32629/asc.v2i4.521
Mah, O. B. P., Yan, Y., Tan, J. S. Y., Tan, Y., Tay, G. Q. Y., Chiam, D. J., Wang, Y., Dean, K., & Feng, C. (2019). Generating a virtual tour for the preservation of the (in)tangible cultural heritage of Tampines Chinese Temple in Singapore. Journal of Cultural Heritage, 39, 202–211. https://doi.org/10.1016/j.culher.2019.04.004
Marto, A., Goncalves, A., & Bessa, M. (2018). The Scope of Multisensory Experiences in Cultural Heritage Sites. Conference: 2018 International Conference on Graphics and Interaction (ICGI). https://doi.org/10.1109/itcgi.2018.8602968
Narayan, S. (2021, December 16). The past, present and future of Immersive technologies. Medium. https://medium.com/analytics-vidhya/the-past-present-and-future-of-immersive-technologies-88b82a5db28a
Orcalli, A. (2001). On the methodologies of audio restoration. Journal of New Music Research, 30(4), 307-322.
Rafaely, B., Tourbabin, V., Habets, E., Ben-Hur, Z., Lee, H., Gamper, H., Arbel, L., Birnie, L., Abhayapala, T., & Samarasinghe, P. (2022). Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges. Acta Acustica, 6, 47. https://doi.org/10.1051/aacus/2022040
Roper, M., & Millar, L. (1999). Managing public sector records: A study programme. glossary. International Records Management Trust.
Schüller, D. (2008). Audiovisual research collections and their preservation. Amsterdam: European
Shehade, M., & Stylianou-Lambert, T. (2020). Virtual Reality in Museums: Exploring the experiences of museum professionals. Applied Sciences, 10(11), 4031. https://doi.org/10.3390/app10114031
Syukur, A., Andono, P. N., Hastuti, K., & Syarif, A. M. (2023). Immersive and challenging experiences
Taylor, T. (2024, January 31). An introduction to wave field synthesis for Performance Audio. https://www.linkedin.com/pulse/introduction-wave-field-synthesis-performance-audio-travis-taylor-jkl8e through a virtual reality musical instruments game: an approach to gamelan preservation. Journal of Metaverse, 3(1), 34-42.
Tong, Y., & Ma, Y. (2021). DIGITAL MUSEUM CONSTRUCTION STANDARDS STUDY. the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences/International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVI-M-1–2021, 753–760. https://doi.org/10.5194/isprs-archives-xlvi-m-1-2021-753-2021
Yang, R., Li, Y., Wang, Y., Zhu, Q., Wang, N., Song, Y., Tian, F., & Xu, H. (2024). Enhancing the Sustainability of Intangible Cultural Heritage Projects: Obtaining Efficient Digital Skills Preservation through Binocular Half Panoramic VR Maps. Sustainability, 16(13), 5281. https://doi.org/10.3390/su16135281
Yi, B. L. (2020, November 3). Sound conservation: A different way of preserving history. The Christian Science Monitor. https://www.csmonitor.com/World/Asia-Pacific/2020/1103/Sound-conservation-a-different-way-of-preserving-history
Zhou, Y., Sun, J., & Huang, Y. (2019). The digital Preservation of Intangible cultural heritage in China: a survey. Preservation, Digital Technology & Culture, 48(2), 95–103. https://doi.org/10.1515/pdtc-2019-0004.
Guanzhou, L., Musib, A. F. bin, & Mohd.Norowi, N. (2024). A Literature Review on the Audio Preservation of Jin Opera through Multi-Channel AR Design Tools. International Journal of Academic Research in Business and Social Sciences, 14(10), 1757–1768.
Copyright: © 2024 The Author(s)
Published by Knowledge Words Publications (www.kwpublications.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode
