Abstract
The combination of LiDAR data with panoramic images could be of great benefit to many geo-related applications and processes such as measuring and map making. Although it is possible to record both LiDAR points and panoramic images at the same time, there are economic and practical advantages to separating the acquisition of both types of data. However, when LiDAR and image data is recorded separately, poor GPS reception in many urban areas will make registration between the data sets necessary. In this paper, we describe a method to register a sequence of panoramic images to a LiDAR point cloud using a non-rigid version of ICP that incorporates a bundle adjustment framework. The registration is then refined by integrating image-to-reflectance data SIFT correspondences into the bundle adjustment. We demonstrate the validity of this registration method by a comparison against ground truth data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Besl, P., McKay, N.: A Method for Registration of 3-D Shapes. IEEE T. Pattern Anal. 14(2), 239–256 (1992)
Böhm, J., Becker, S.: Automatic Marker-Free Registration of Terrestrial Laser Scans using Reflectance Features. In: 8th Conference on Optical 3D Measurement Techniques, pp. 338–344 (2007)
Carlberg, M., Andrews, J., Gao, P., Zakhor, A.: Fast Surface Reconstruction and Segmentation with Ground-Based and Airborne Lidar Range Data. In: 4th International Symposium on 3D Data Processing, Visualization and Transmission, pp. 97–104 (2008)
Chen, Y., Medioni, G.: Object Modeling by Registration of Multiple Range Images. In: 1991 IEEE International Conference on Robotics and Automation, pp. 2724–2729 (1991)
Clarkson, M., Rueckert, D., Hill, D., Hawkes, D.: Using Photo-Consistency to Register 2D Optical Images of the Human Face to a 3D Surface Model. IEEE T. Pattern Anal. 23(11), 1266–1280 (2001)
van den Heuvel, F., Beers, B., Verwaal, R.: Method and system for producing a panoramic image from a vehicle. European Patent EP1903534 (2008)
Huber, P.: Robust Regression: Asymptotics, Conjectures and Monte Carlo. Ann. Stat. 1(5), 799–821 (1973)
Li, Y., Low, K.: Automatic Registration of Color Images to 3D Geometry. In: Proceedings of the 2009 Computer Graphics International Conference, pp. 21–28. ACM, New York (2009)
Liu, L., Stamos, I.: Automatic 3D to 2D Registration for the Photorealistic Rendering of Urban Scenes. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 137–143 (2005)
Lothe, P., Bourgeois, S., Dekeyser, F., Royer, E., Dhome, M.: Towards Geographical Referencing of Monocular SLAM Reconstruction using 3D City Models: Application to Real-Time Accurate Vision-Based Localization. In: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2882–2889 (2009)
Lourakis, M., Argyros, A.: SBA: A Software Package for Generic Sparse Bundle Adjustment. ACM. T. Math. Software 36(1), 1–30 (2009)
Lowe, D.: Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)
Mastin, A., Kepner, J., Fisher, J.: Automatic Registration of LIDAR and Optical Images of Urban Scenes. In: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2639–2646 (2009)
Optech: Lynx mobile mapper data sheet (2007), http://www.optech.ca/pdf/LynxDataSheet.pdf
Pomerleau, F., Colas, F., Ferland, F., Michaud, F.: Relative Motion Threshold for Rejection in ICP Registration. In: Howard, A., Iagnemma, K., Kelly, A. (eds.) Field and Service Robotics: Results of the 7th International Conference, pp. 229–238. Springer, Heidelberg (2010)
Zhao, W., Nister, D., Hsu, S.: Alignment of Continuous Video onto 3D Point Clouds. IEEE T. Pattern Anal. 27(8), 1305–1318 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Swart, A., Broere, J., Veltkamp, R., Tan, R. (2011). Refined Non-rigid Registration of a Panoramic Image Sequence to a LiDAR Point Cloud. In: Stilla, U., Rottensteiner, F., Mayer, H., Jutzi, B., Butenuth, M. (eds) Photogrammetric Image Analysis. PIA 2011. Lecture Notes in Computer Science, vol 6952. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24393-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-24393-6_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24392-9
Online ISBN: 978-3-642-24393-6
eBook Packages: Computer ScienceComputer Science (R0)