Abstract
A large part of the world is already covered by maps of buildings, through projects such as OpenStreetMap. However when a new image of an already covered area is captured, it does not align perfectly with the buildings of the already existing map, due to a change of capture angle, atmospheric perturbations, human error when annotating buildings or lack of precision of the map data. Some of those deformations can be partially corrected, but not perfectly, which leads to misalignments. Additionally, new buildings can appear in the image. Leveraging multi-task learning, our deep learning model aligns the existing building polygons to the new image through a displacement output, and also detects new buildings that do not appear in the cadaster through a segmentation output. It uses multiple neural networks at successive resolutions to output a displacement field and a pixel-wise segmentation of the new buildings from coarser to finer scales. We also apply our method to buildings height estimation, by aligning cadaster data to the rooftops of stereo images. The code is available at https://github.com/Lydorn/mapalignment.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bradbury, K., et al.: Aerial imagery object identification dataset for building and road detection, and building height estimation, July 2016
Charpiat, G., Faugeras, O., Keriven, R.: Image statistics based on diffeomorphic matching. In: ICCV, October 2005
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, June 2005
Fischer, P., et al.: FlowNet: learning optical flow with convolutional networks. CoRR (2015)
Hermosillo, G., Chefd’Hotel, C., Faugeras, O.: Variational methods for multimodal image matching. Int. J. Comput. Vis. 50, 329–343 (2002)
Licciardi, G.A., Villa, A., Mura, M.D., Bruzzone, L., Chanussot, J., Benediktsson, J.A.: Retrieval of the height of buildings from worldview-2 multi-angular imagery using attribute filters and geometric invariant moments. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens. 5, 71–79 (2012)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)
Maggiori, E., Tarabalka, Y., Charpiat, G., Alliez, P.: Can semantic labeling methods generalize to any city? The Inria aerial image labeling benchmark. In: IGARSS (2017)
Manfré, L.A., et al.: An analysis of geospatial technologies for risk and natural disaster management. ISPRS Int. J. Geo-Inf. 1, 166–185 (2012)
OpenStreetMap contributors: Planet dump (2017). Accessed https://planet.osm.org
Ptucha, R., Azary, S., Savakis, A.: Keypoint matching and image registration using sparse representations. In: IEEE International Conference on Image Processing, September 2013
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Ruder, S.: An overview of multi-task learning in deep neural networks. CoRR (2017)
Thompson, J.A., Bell, J.C., Butler, C.A.: Digital elevation model resolution: effects on terrain attribute calculation and quantitative soil-landscape modeling. Geoderma 100, 67–89 (2001)
Wang, A.: Correction of atmospheric effects on earth imaging (extended inverse method). Math. Model. 9, 533–537 (1987)
Wright, J.K.: Map makers are human: comments on the subjective in maps. Geogr. Rev. 32, 527–544 (1942)
Yang, X., Kwitt, R., Niethammer, M.: Quicksilver: fast predictive image registration - a deep learning approach. CoRR (2017)
Ye, Y., Shan, J., Bruzzone, L., Shen, L.: Robust registration of multimodal remote sensing images based on structural similarity. IEEE Trans. Geosci. Remote Sens. 55, 2941–2958 (2017)
Zampieri, A., Charpiat, G., Tarabalka, Y.: Coarse to fine non-rigid registration: a chain of scale-specific neural networks for multimodal image alignment with application to remote sensing. CoRR (2018)
Acknowledgments
This work benefited from the support of the project EPITOME ANR-17-CE23-0009 of the French National Research Agency (ANR). We also thank Luxcarta for providing satellite images with corresponding ground truth data and Alain Giros for fruitful discussions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Girard, N., Charpiat, G., Tarabalka, Y. (2019). Aligning and Updating Cadaster Maps with Aerial Images by Multi-task, Multi-resolution Deep Learning. In: Jawahar, C., Li, H., Mori, G., Schindler, K. (eds) Computer Vision – ACCV 2018. ACCV 2018. Lecture Notes in Computer Science(), vol 11365. Springer, Cham. https://doi.org/10.1007/978-3-030-20873-8_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-20873-8_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-20872-1
Online ISBN: 978-3-030-20873-8
eBook Packages: Computer ScienceComputer Science (R0)