( 1 of 1 ) |
United States Patent | 6,760,488 |
Moura , et al. | July 6, 2004 |
A system for generating a three-dimensional model of an object from a two-dimensional image sequence. According to one embodiment, the system includes an image sensor for capturing a sequence of two-dimensional images of a scene, the scene including the object, a two-dimensional motion filter module in communication with the image sensor for determining from the sequence of images a plurality of two-dimensional motion parameters for the object, and a three-dimensional structure recovery module in communication with the two-dimensional motion filter module for estimating a set of three-dimensional shape parameters and a set of three-dimensional motion parameters from the set of two-dimensional motion parameters using a rank 1 factorization of a matrix.
Inventors: | Moura; Jose' M. F. (Pittsburgh, PA); Aguiar; Pedro M. Q. (Lisbon, PT) |
Assignee: | Carnegie Mellon University (Pittsburgh, PA) |
Appl. No.: | 614841 |
Filed: | July 12, 2000 |
Current U.S. Class: | 382/285; 345/419 |
Intern'l Class: | G06K 009/36 |
Field of Search: | 382/285,260,265,266,100 345/419,418 348/135,147 |
5475422 | Dec., 1995 | Mori et al. | 348/48. |
5579401 | Nov., 1996 | Gear | 382/100. |
6009437 | Dec., 1999 | Jacobs | 707/102. |
6137491 | Oct., 2000 | Szeliski | 345/419. |
C. Tomasi and T. Kanade, "Shape and Motion from Image Streams under Orthography: A Factorization Method," International Journal of Computer Vision, vol. 9, No. 2, pp. 137-154, 1992. R. Tsai and T. Huang, "Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces," IEEE Transactions on PAMI, vol. 6, No. 1, Jan., 1984. T. Broida and R. Chellappa, "Estimating the Kinematics and Structure of a Rigid Object form a Sequence of Monocular Images," IEEE Transactions on PAMI, vol. 13, No. 6, Jun., 1991. R. Szelinski and S. Kang, "Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares," Journal of Visual Communication and Image Representation, vol. 5, No. 1, pp. 10-28, Mar., 1994. S. Soatto, P. Perona, R. Frezza, and G. Picci, "Recursive Motion and Structure Estimation with Complete Error Characterization," IEEE Conference on CVPR, Jun. 1993, pp. 428-433. J. Thomas, A. Hanson, and J. Oliensis, "Understanding Noise: The Critical Role of Motion Error in Scene Reconstruction," in IEEE Int. Conference in Computer Vision, 1993, pp. 325-329. C. Poelman and T. Kanade, "A Paraperspective Factorization Method for Shape and Motion Recovery," IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 19, No. 3, Mar., 1997. J. P. Costeira and T. Kanade, "A Multibody Factorization Method for Independently Moving Objects," International Journal of Computer Vision, 29(3), pp. 159-179, 1998. J. R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani, "Hierarchical Model-Based Motion Estimation," in European Conference on Computer Vision, Italy, pp. 237-252, May 1992. H. Zheng and S. D. Blostein, "Motion-Based Object Segmentaion and Estimation Using the MDL Principle," IEEE Transactions on Image Processing, vol. 4, No. 9, Sep., 1995. S. Mann and R. Picard, "Video Orbits of the Projective Group: A Simple Approach to Featureless Estimation of Parameters," IEEE Trans. On Image Processing, vol. 6, No. 9, Sep., 1997. M. Chang, A. Tekalp, and M. Sezan, "Simultaneous Motion Estimation and Segmentation," IEEE Trans. On Image Processing, vol. 6, No. 9, 1997. R. S. Jasinschi and J.M.F. Moura, "Generative Video: A Meta Video Framework," submitted for publication Jun., 1996. T. Morita and T. Kanade, "A Sequential Factorization Method for Recovering Shape and Motion From Image Streams," IEEE Transactions on PAMI, vol. 19, No. 8, Aug., 1997. F.C.M. Martins and J.M.F. Moura, "Video Representation With Three-Dimensional Entities," IEEE Journal on Selected Areas in Communications, vol. 16, No. 1, Jan., 1998. |