Immersive Visual Communication with Depth

Опубликовано 17 августа 2016, 2:23

In this talk I will present some of our recent efforts in exploring the recent emerging of low-cost and fast depth cameras to advance visual communication. First, we will discuss a 3D propagation algorithm that allows efficient integration of multiple color and depth cameras in synthesizing novel views. We will show how the quality of novel view rendering can be quantitatively analyzed using the scene and sensor parameters. We will also present a novel approach for improving the resolution and quality of a depth video given its corresponding high-resolution color video. Next, we will discuss the parallelization of free-viewpoint rendering algorithms in GPU architectures. Finally, we will show experiments with synthetic and real data sets to demonstrate the potential of the proposed approach for immersive communication. Joint work with Ha Nguyen, Quang Nguyen, Sanjay Patel, Dongbo Min, and Jiangbo Lu