We characterize the class of image plane transformations which realize rigid camera motions and call these transformations ‘rigidity preserving’. It turns out that the only rigidity preserving image transformations are homographies corresponding to rotating the camera. In particular, 2D translations of pinhole images are not rigidity preserving. Hence, when using CNNs for 3D inference tasks, it can be beneficial to modify the inductive bias from equivariance w.r.t. translations to equivariance w.r.t. rotational homographies. We investigate how equivariance with respect to rotational homographies can be approximated in CNNs, and test our ideas on 6D object pose estimation. Experimentally, we improve on a competitive baseline.
CITATION STYLE
Brynte, L., Bökman, G., Flinth, A., & Kahl, F. (2023). Rigidity Preserving Image Transformations and Equivariance in Perspective. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 13886 LNCS, pp. 59–76). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-31438-4_5
Mendeley helps you to discover research relevant for your work.