Integrated 3D scene flow and structure recovery from multiview image sequences
Authors:
- C. KambhamettuCKC. Kambhamettu
- 7 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2 (10636919) , 674-681
Abstract
Scene flow is the 3D motion field of points in the world. Given N (N>1) image sequences gathered with a N-eye stereo camera or N calibrated cameras, we present a novel system which integrates 3D scene flow and structure recovery in order to complement each other's performance. We do not assume rigidity of the scene motion, thus allowing for non-rigid motion in the scene. In our work, images are segmented into small regions. We assume that each small region is undergoing similar motion, represented by a 3D affine model. Nonlinear motion model fitting based on both optical flow constraints and stereo constraints is then carried over each image region in order to simultaneously estimate 3D motion correspondences and structure. To ensure the robustness, several regularization constraints are also introduced. A recursive algorithm is designed to incorporate the local and regularization constraints. Experimental results on both synthetic and real data demonstrate the effectiveness of our integrated 3D motion and structure analysis scheme.Keywords
This publication has 24 references indexed in Scilit:
- Stereo correspondence from motion correspondence2003
- Coupled, multi-resolution stereo and motion analysis2002
- Three-dimensional scene flow1999
- A fast scalable algorithm for discontinuous optical flow estimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Skin and bones: multi-layer, locally affine, optical flow and regularization with transparency1996
- Optic flow field segmentation and motion estimation using a robust genetic partitioning algorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 1995
- 3-D translational motion and structure from binocular image flowsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- 3-D motion estimation in model-based facial image codingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Optimal motion and structure estimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Structure from stereo-a reviewIEEE Transactions on Systems, Man, and Cybernetics, 1989