SnapToReality: Aligning Augmented Reality to the Real World

Опубликовано 3 мая 2016, 21:11

Augmented Reality (AR) applications may require the precise alignment of virtual objects to the real world. We propose automatic alignment of virtual objects to physical constraints calculated from the real world in real time (“snapping to reality”). We demonstrate SnapToReality alignment techniques that allow users to position, rotate, and scale virtual content to dynamic, real world scenes. Our proof-of-concept prototype extracts 3D edge and planar surface constraints. We furthermore discuss the unique design challenges of snapping in AR, including the user’s limited field of view, noise in constraint extraction, issues with changing the view in AR, visualizing constraints, and more. We also report the results of a user study evaluating SnapToReality, confirming that aligning objects to the real world is significantly faster when assisted by snapping to dynamically extracted constraints. Perhaps more importantly, we also found that snapping in AR enables a fresh and expressive form of AR content creation.

As presented at ACM CHI 2016 on behalf of:
Benjamin Nuernberger, University of California, Santa Barbara
Eyal Ofek, Microsoft Research
Hrvoje Benko, Microsoft Research
Andrew D. Wilson, Microsoft Research

research.microsoft.com