Capture and Recreation of Spatial Audio for HCI and Virtual Reality

Опубликовано 6 сентября 2016, 5:46

After a brief introduction to my broader research, this talk will focus on research on the capture of spatial sound, and its reproduction over headphones and speakers. Humans are very good at discerning the spatial origin of sound using a mixture of monaural and binaural cues in disparate environments ranging from open spaces to small crowded rooms. This ability helps us to interact with others and the environment by sorting out individual sounds from a mixture, and helps us to survive by warning us of danger over a wider region of space compared to vision. These advantages of spatial sound are also potentially of benefit in the fields of human-computer interaction, teleconferencing and telepresence. In this talk I will present an introduction to the problem of creating and acquiring spatially valid audio, and present our recent results in           1) developing a novel way for extremely fast acquisition of HRTFs for individuals, using a combination of scientific computation and ingenious experimentation        2) a technique for real-time acquisition and image-based rendering of soundscapes using multi microphone acquisition using spherical microphone arrays