Multimodal Devices: Learnings from Multisensory Perception and Plasticity

Опубликовано 21 марта 2019, 17:25

We often think about perceptual experiences one modality at a time; we “see” this or we “hear” that, etc. These distinctions often imply that our perception of each sense is independent from each other. Research in human neuroscience, however, increasingly supports a multisensory view of human perception whereby our perception of any one sensory modality is a product of simultaneous information streams from all the available senses. Discrepant information between two or more senses, can lead to perceptual illusions and/or plastic changes in future perception in each sensory modality. In this talk, I will discuss how research in multisensory perception and multisensory plasticity can be used to provide more compelling and intuitive experiences for users as products become increasingly multi-modal (particularly in the domain of virtual and augmented reality).

See more at microsoft.com/en-us/research/v...