This sketch describes a real-time virtual video camera application based on view morphing. This system takes video input from multiple cameras aimed at the same subject from different angles. After performing real-time pattern matching, the system generates synthetic views for a virtual camera that can pan between any two real views. The approach of this paper differs from the more common “depth from stereo” method for generating virtual views in that it does not attempt to reconstruct the 3D structure of the original scene. Instead it takes two 2D images and directly generates the 2D output by performing only planar operations. At the heart of the system are algorithms and data structures that support the fast inter-image correlation needed for the completely automated, real-time view morphing.

URL

Timm, K., Real-Time Video View Morphing, Proceedings of SIGGRAPH 03 : International Conference on Computer Graphics and Interactive Techniques, San Diego, CA, ACM SIGGRAPH, July 28th, 2003. http://www.evl.uic.edu/ktimm/sketch.doc