Non-rigid structure-from-motion on degenerate deformations with low-rank shape deformation model

11Citations
Citations of this article
33Readers
Mendeley users who have this article in their library.

Abstract

Non-rigid structure-from-motion (NRSfM) is the process of recovering time-varying 3D structures and poses of a deformable object from an uncalibrated monocular video sequence. Currently, most NRSfM algorithms utilize a non- degenerate assumption for non-rigid object deformations whereby the 3D structures of a non-rigid object can be assumed to be a linear combination of basis shapes with full rank three. Unfortunately, this assumption will produce extra degrees-of-freedom when the non-rigid object has some degenerate deformations with shape bases of rank less than three. These extra degrees-of-freedom will yield spurious shape deformations due to non-negligible noise in real applications, which will cause substantial reconstruction errors. To solve this problem, we propose a low-rank shape deformation model to represent 3D structures of degenerate deformations. When modeling degenerate deformations, the proposed model exploits the rank-deficient nature of degenerate deformations in addition to the low-rank property of non-rigid objects' trajectories, thus providing a more accurate and compact representation compared with existing models. Based on this model, we formulate the NRSfM problem as two coherent optimization problems. These problems are solved with iterative non-linear optimization algorithms. Experiments on synthetic and motion capture data are conducted. The results exhibit the significant advantages of our approach over state-of-the-art NRSfM algorithms for the 3D recovery of non-rigid objects with degenerate deformations.

References Powered by Scopus

Video google: A text retrieval approach to object matching in videos

5676Citations
N/AReaders
Get full text

Matrix Differential Calculus with Applications in Statistics and Econometrics

2389Citations
N/AReaders
Get full text

Shape and motion from image streams under orthography: a factorization method

2227Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Robust generalized low-rank decomposition of multimatrices for image recovery

43Citations
N/AReaders
Get full text

DRM-SLAM: Towards dense reconstruction of monocular SLAM with scene depth fusion

30Citations
N/AReaders
Get full text

Single Image Depth Estimation with Normal Guided Scale Invariant Deep Convolutional Fields

24Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Zhou, Z., Shi, F., Xiao, J., & Wu, W. (2015). Non-rigid structure-from-motion on degenerate deformations with low-rank shape deformation model. IEEE Transactions on Multimedia, 17(2), 171–185. https://doi.org/10.1109/TMM.2014.2384396

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 18

78%

Lecturer / Post doc 2

9%

Researcher 2

9%

Professor / Associate Prof. 1

4%

Readers' Discipline

Tooltip

Computer Science 16

64%

Engineering 7

28%

Design 1

4%

Pharmacology, Toxicology and Pharmaceut... 1

4%

Save time finding and organizing research with Mendeley

Sign up for free