Sinkronisasi Sensasi Pendengaran dan Visual di dalam Dunia Simulasi Komputer

Sentagi S. Utami, Mojtaba Navvab, Randy F. Fela

Abstract


Current application of virtual environment synthesized by computer simulation still focuses on generating visual cues, while auditory cues has not yet been optimized to create individual movements within the virtual space. Auditory cueing is limited to the ability in detecting the presence of a sound source without further perception. Auralization of variety of spaces with the impact of a variety of architectural elements were synthesized. The auralization data were produced using current computer-simulation technique where both visual and acoustics properties of the room boundaries are considered. Noticeable differences in the auditory cognition of the virtual spaces are measured through the use of subjective evaluation. The acoustical quality are also evaluated utilizing several objective acoustic measures. Diffuser panels were able to increased ability of sound localization up to 12.5% out of the 40 respondents. These panels also increased the speech intelligibility quality, indicated both by the C50 which increased by 89% with 97.5% of respondents approved this condition. Analysis of the subjective and objective measures indicates to what extent the alteration of the simulation is required to create a noticeable auditory cues that enhance the auditory and visual sensation of the virtual space.

Full Text:

PDF

References


Suied, C., N. Bonneel, et al., "The Role of Auditory-Visual Integration in Object Recognition.", The Journal of the Acoustical Society of America 123(5): 3568-3568, 2008.

Lauter, J., E. Mathukutty, et al., "How can a video game cause panic attacks? 1. Effects of an auditory stressor on the human brainstem." Proceedings of Meetings on Acoustics 8(1): 050001-18, 2009.

Vorländer, M., “Simulation of the Transient and Steady-State Sound Propagation in Rooms Using a New Combined Ray Tracing/Image-Source Algorithm,”, J.Acoust. Soc. Am., 1989.

Braasch, J., W. L. Martens, et al., "Acoustic rendering of a virtual environment based on virtual microphone control and binaural room scanning.", The Journal of the Acoustical Society of America 120(5): 3095, 2006.

Funkhouser, T., I. Carlbom, et al., "Interactive acoustic modeling of complex environments.", The Journal of the Acoustical Society of America 105(2): 1357-1358, 1999.

Lentz, T., Schroder, D., Vorlander, M., and Assenmacher, I., "Virtual Reality System with Integrated Sound Field Simulation and Reproduction." EURASIP Journal on Advances in Signal Processing Article ID 70540: 19 pages, 2007.

T. Lokki, et.al., ”A Case Study of Auditory Navigation in Virtual Acoustic Environments”, Proc. 6th Int’l Conf. Auditory Display, 2000, Int’l Community of Auditory Display, pp. 145-150, 2000.

Sahrhage, J., "Design criteria for auditory virtual environment." The Journal of the Acoustical Society of America 105(2): 981, 1999.

Vorlander, M. and SpringerLink, Auralization Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality. Berlin, Heidelberg, Springer-Verlag Berlin Heidelberg, 2008.

Lehnert, H. and J. Blauert, "Principles of binaural room simulation." Applied Acoustics 36(3-4): 259-291, 1992.

Hodgson, M., "On measures to increase sound-field diffuseness and the applicability of diffuse-field theory", The Journal of the Acoustical Society of America 95, 3651-3653, 1994.

(2003) Michigan State University Acoustics/Psychoacoustics website [Online], http://www.pa.msu.edu/acoustics/.

Schroeder, M. R., "Frequency-Correlation Functions of Frequency Responses in Rooms", The Journal of the Acoustical Society of America 34, 1819-1823, 1962.

Hartmann, W. M., "Localization of sound in rooms", The Journal of the Acoustical Society of America 74(5): 1380-1391, 1983.

Rakerd, B. and W. M. Hartmann, "Localization of sound in rooms, II: The effects of a single reflecting surface.", The Journal of the Acoustical Society of America 78(2): 524-533, 1985.




DOI: http://dx.doi.org/10.22146/jnteti.v5i2.227

Refbacks

  • There are currently no refbacks.


Copyright (c) 2016 Jurnal Nasional Teknik Elektro dan Teknologi Informasi (JNTETI)

JNTETI (Jurnal Nasional Teknik Elektro dan Teknologi Informasi)

Departemen Teknik Elektro dan Teknologi Informasi, Fakultas Teknik Universitas Gadjah Mada
Jl. Grafika No 2. Kampus UGM Yogyakarta 55281
+62 274 552305
jnteti@ugm.ac.id