Abstract
Robust local image features have been used successfully in robot localization and camera pose estimation; region tracking using affine warps is considered state of the art also for many years. Although such correspondences provide a warp of the local image region and are quite powerful, in direct pose estimation they are so far only considered as points and therefore three of them are required to construct a camera pose. In this contribution we show how it is possible to directly compute a pose based upon one such feature, given the plane in space where it lies. This differential correspondence concept exploits the texture warp and has recently gained attention in estimation of conjugate rotations. The approach can also be considered as the limiting case of the well-known spatial resection problem when the three 3D points approach each other infinitesimally close. We show that the differential correspondence is more powerful than conic correspondences while its exploitation requires nothing more complicated than the roots of a third order polynomial. We give a detailed sensitivity analysis, a comparison against state-of-the-art pose estimators and demonstrate real-world applicability of the algorithm based on automatic region recognition.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. International Journal of Computer Vision 74(1), 59–73 (2007)
Chum, O., Matas, J., Obdrzalek, S.: Epipolar geometry from three correspondences. In: Computer Vision Winter Workshop, Prague, pp. 83–88 (2003)
Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: Monoslam: Real-time single camera slam. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 1052–1067 (2007)
DeMenthon, D., Davis, L.S.: Model-based object pose in 25 lines of code. International Journal of Computer Vision 15, 123–141 (1995)
Finsterwalder, S., Scheufele, W.: Das Rückwärtseinschneiden im Raum. In: Bayerische, K., der Wissenschaften, A. (eds.) Sitzungsberichte der mathematisch-physikalischen Klasse, vol. 23/4, pp. 591–614 (1903)
Fischler, M., Bolles, R.: RANdom SAmpling Consensus: a paradigm for model fitting with application to image analysis and automated cartography. Communications of the ACM 24(6), 381–395 (1981)
Grunert, J.A.: Das Pothenot’sche Problem, in erweiterter Gestalt; nebst Bemerkungen über seine Anwendung in der Geodäsie. In: Archiv der Mathematik und Physik, vol. 1, pp. 238–248, Greifswald. Verlag C.A. Koch (1841)
Haralick, B., Lee, C., Ottenberg, K., Nölle, M.: Review and analysis of solutions of the three point perspective pose estimation problem. International Journal of Computer Vision 13(3), 331–356 (1994)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
Irani, M., Rousso, B., Peleg, S.: Recovery of ego-motion using region alignment. Transact. on Pattern Analysis and Machine Intelligence 19(3), 268–272 (1997)
Jin, H., Favaro, P., Soatto, S.: A semi-direct approach to structure from motion. The Visual Computer 19(6), 377–394 (2003)
Kahl, F., Heyden, A.: Using conic correspondence in two images to estimate the epipolar geometry. In: Proceedings of ICCV, pp. 761–766 (1998)
Kähler, O., Denzler, J.: Rigid motion constraints for tracking planar objects. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 102–111. Springer, Heidelberg (2007)
Kannala, J., Salo, M., Heikkila, J.: Algorithms for computing a planar homography from conics in correspondence. In: Proceedings of BMVC 2006 (2006)
Koeser, K., Beder, C., Koch, R.: Conjugate rotation: Parameterization and estimation from an affine feature corespondence. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2008)
Koeser, K., Koch, R.: Exploiting uncertainty propagation in gradient-based image registration. In: Proc. of BMVC 2008 (to appear, 2008)
Kyle, S.: Using parallel projection mathematics to orient an object relative to a single image. The Photogrammetric Record 19, 38–50 (2004)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: IJCAI 1981, pp. 674–679 (1981)
De Ma, S.: Conics-based stereo, motion estimation, and pose determination. International Journal of Computer Vision 10(1), 7–25 (1993)
Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of BMVC 2002 (2002)
McGlone, J.C. (ed.): Manual of Photogrammetry, 5th edn. ASPRS (2004)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. Transact. on Pattern Analysis and Machine Intell. 27(10), 1615–1630 (2005)
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., van Gool, L.: A comparison of affine region detectors. International Journal of Computer Vision 65(1-2), 43–72 (2005)
Oberkampf, D., DeMenthon, D., Davis, L.S.: Iterative pose estimation using coplanar feature points. CVGIP 63(3) (1996)
Riggi, F., Toews, M., Arbel, T.: Fundamental matrix estimation via TIP - transfer of invariant parameters. In: Proceedings of the 18th International Conference on Pattern Recognition, Hong Kong, August 2006, pp. 21–24 (2006)
Rothganger, F., Lazebnik, S., Schmid, C., Ponce, J.: Segmenting, modeling, and matching video clips containing multiple moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(3), 477–491 (2007)
Schmid, C., Zisserman, A.: The geometry and matching of lines and curves over multiple views. International Journal of Computer Vision 40(3), 199–234 (2000)
Se, S., Lowe, D.G., Little, J.: Vision-based global localization and mapping for mobile robots. IEEE Transactions on Robotics 21(3), 364–375 (2005)
Skrypnyk, I., Lowe, D.G.: Scene modelling, recognition and tracking with invariant image features. In: IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 110–119 (2004)
Thompson, E.H.: Space resection: Failure cases. The Photogrammetric Record 5(27), 201–207 (1966)
Williams, B., Klein, G., Reid, I.: Real-time slam relocalisation. In: Proceedings of ICCV, Rio de Janeiro, Brazil, pp. 1–8 (2007)
Zelnik-Manor, L., Irani, M.: Multiview constraints on homographies. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(2), 214–223 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Köser, K., Koch, R. (2008). Differential Spatial Resection - Pose Estimation Using a Single Local Image Feature. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5305. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88693-8_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-88693-8_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88692-1
Online ISBN: 978-3-540-88693-8
eBook Packages: Computer ScienceComputer Science (R0)