Wed, 02/06/2013 - 12:00pm - 1:00pm
The seminar has been cancelled.
2D-to-3D video conversion
There is a renewed interest in stereo movies due to the general improvement in stereo films as well as technological advances in 3D display technologies. However, the stream of new stereo films is slow due to the additional overhead of using multiple cameras and the expertise required to use stereo in a compelling manner. It follows that a solution to this content problem (which is seen as inhibiting wider adoption of stereo technology) is to convert recent and legacy 2D films into stereo. In this talk, I will describe two approaches to convert regular video to stereoscopic video. The first approach is in the form of an interactive system we call “Depth Director.” Depth Director assists rotoscoping with temporally-coherent segmentation techniques, extracts depths using structure from motion, and uses what we call “depth templates” to enforce real-world 3D constraints into the system. Through Depth Director's novel interactive user interface, the user is given as much or as little control as desired to overcome accuracy issues with automatic computer vision algorithms and to manipulate the relative “depth contrast” between objects. The second approach is automatic and makes use of non-parametric depth sampling. We use local motion cues to improve the inferred depth maps, while optical flow is used to ensure temporal depth consistency. For training and evaluation, we use a Kinect-based system to collect a large dataset containing stereoscopic videos with known depths.
Sing Bing Kang is a principal researcher at Microsoft Research and adjunct faculty with School of Interactive Computing, Gatech. He received his Ph.D. in robotics from Carnegie Mellon University, Pittsburgh in 1994. His areas of interest are computer vision and computer graphics, more specifically image-based modeling as well as image and video enhancement. Sing Bing has co-edited two books ("Panoramic Vision" and "Emerging Topics in Computer Vision") and co-authored two books ("Image-Based Rendering" and "Image-Based Modeling of Plants and Trees"). He has served as area chair and member of technical committee for the major computer vision conferences (ICCV, CVPR, ECCV). In addition, he has served as papers committee member for SIGGRAPH and SIGGRAPH Asia. Sing Bing was program chair for ACCV 2007 and CVPR 2009, and is currently Associate Editor-in-Chief for IEEE Transactions on Pattern Analysis and Machine Intelligence. He is an IEEE Fellow.