Dynamosaics: Dynamic Mosaics with Non-Chronological Time

Опубликовано 6 сентября 2016, 5:11

With the limited field of view of human vision, our perception of most scenes is built over time while our eyes are scanning the scenes. In the case of static scenes this process can be modeled by panoramic mosaicing: stitching together images into a panoramic view. Can a dynamic scene, scanned by a video camera, be represented with a dynamic panoramic video? When a video camera is scanning a dynamic scene, different regions are visible at different times. The chronological time when a region becomes visible in the input video is not part of the scene dynamics, and may be ignored. Only the ΓÇ£local timeΓÇ¥ during the visibility period of each region is relevant for the dynamics of the scene, and should be used for building the dynamic mosaics. We used the space-time volume, when 2D image frames are stacked on the time axis to form a 3D volume, as a basic representation which enables to create dynamic mosaics. Various 2D slices of the space-time volume can manipulate the chronological time and generate panoramic movies. The chronological time can even be reversed without affecting the local time. E.g., Given a video camera scanning water falls from left to right, we can generate a video scanning the falls from right to left, but in contradiction to reversal of the video sequence, the water will flow down!