An automatic image matching algorithm based on thin plate splines

Abstract

There are substantial problems in the photogrammetric image matching especially in the images taken by UAVs in the regions where grassland, waterfront, forest, buildings, bridges, high-voltage lines etc. in the urban and rural areas. The main reason of these problems are color, tone, texture, contrast and scale changes cannot be successfully detected in between sequential images. To solve these problems, radial basis functions can be used. The thin plate spline (TPS) that has a natural representation in terms of radial basis functions is used as a non-rigid transformation model in image matching. In other words, TPS is strong interpolation method for coordinate transformations modeling. In this study, the Istanbul Technical University Campus was selected as the study area and the study focused on using the integration of SURF and TPS, called as automatic TPS (A-TPS), for photogrammetric matching of UAV images obtained for the campus. Three different test areas that have different surface characteristics were selected and the implementation of A-TPS realized using control points on these test areas. The A-TPS algorithm was compared with SURF and VisualSFM software that uses the SIFTGPU method. Also, the images were rotated 45 degrees and the same operations were repeated. RANSAC algorithm was applied to determine the inliers from the point matches obtained from all methods. The A-TPS algorithm performs better than the other two methods, especially for images with the homogenous texture of forestry areas.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

References

  1. Ai M, Hu Q, Li J, Wang M, Yuan H, Wang S (2015) A robust photogrammetric processing method of low-altitude UAV images. Remote Sens 7:2302–2333. https://doi.org/10.3390/rs70302302

    Article  Google Scholar 

  2. Akcay O, Erenoglu RC, Avsar EO (2017) The effect of JPEG compression in close range photogrammetry. International Journal of Engineering and Geosciences 2(1):35–40

    Article  Google Scholar 

  3. Barrodale I, Kuwahara R, Poeckert R, Skea D (1993) Side-scan sonar image processing using thin plate splines and control point matching. Numerical Algorithms 5:85–98. https://doi.org/10.1007/BF02212041

    Article  Google Scholar 

  4. Bay H, Tuytelaars T, Van Gool L (2006) SURF: speeded up robust features computer vision – ECCV 2006. In: Computer Vision – ECCV 2006. https://doi.org/10.1007/11744023_32

  5. Buhmann MD (2003) Radial basis functions: theory and implementations. Radial Basis Functions, 12. https://doi.org/10.1017/CBO9780511543241

  6. Calonder M, Lepetit V, Strecha C, Fua P (2010) BRIEF: binary robust independent elementary features. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-642-15561-1_56

  7. Du Q, Raksuntorn N, Orduyilmaz A, Bruce LM (2008) Automatic registration and mosaicking for airborne multispectral image sequences. Photogrammetric Engineering and Remote Sensing. https://doi.org/10.14358/PERS.74.2.169

  8. Duran Z, Aydar U (2012) Digital modeling of world's first known length reference unit: the Nippur cubit rod. J Cult Herit 13(3):352–356

    Article  Google Scholar 

  9. Eisenbeiss H (2009) UAV photogrammetry. ETH Zürich. https://doi.org/10.3929/ethz-a-005939264

  10. Fogel DN, Tinney LR (1996) Image registration using multiquadric functions, the finite element method, bivariate mapping polynomials and thin plate spline (96–1)

  11. Gan H, Lee WS, Alchanatis V (2018) A photogrammetry-based image registration method for multi-camera systems – with applications in images of a tree crop. Biosyst Eng 174:89–106. https://doi.org/10.1016/j.biosystemseng.2018.06.013

    Article  Google Scholar 

  12. Guo H, Hou Y, Zhao Y (2016) An image matching algorithm using thin plate splines (Tps) transformation model. International Journal of Simulation -- Systems, Science & Technology 17:13.1–13.5. https://doi.org/10.5013/IJSSST.a.17.08.13

    Article  Google Scholar 

  13. Hassaballah M, Abdelmgeid AA, Alshazly HA (2016) Image features detection, description and matching. Studies in computational intelligence. https://doi.org/10.1007/978-3-319-28854-3_2

  14. Hou W, Wu Z, Ding M (2010) Densely stereo image matching using SURF and TPS 38:91–94

    Google Scholar 

  15. Incekara AH, Delen A, Seker DZ, Goksel C (2019) Investigating the utility potential of low-cost unmanned aerial vehicles in the temporal monitoring of a landfill. ISPRS Int J Geo Inf 8(1):22

    Article  Google Scholar 

  16. Jiang S, Jiang W (2018) Hierarchical motion consistency constraint for efficient geometrical verification in UAV stereo image matching. ISPRS J Photogramm Remote Sens 142:222–242. https://doi.org/10.1016/j.isprsjprs.2018.06.009

    Article  Google Scholar 

  17. Kivilcim CO, Duran Z (2016) A semi-automated point cloud processing methodology for 3D cultural heritage documentation. International archives of the photogrammetry, remote sensing and spatial information sciences 5

  18. Krishna S, Varghese A (2015) Feature based automatic multiview image registration. Int J Comput Sci Softw Eng 4:308–314

    Google Scholar 

  19. Leutenegger S, Chli M, Siegwart RY (2011) BRISK: binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2011.6126542

  20. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94

    Article  Google Scholar 

  21. Moreels P, Perona P (2007) Evaluation of features detectors and descriptors based on 3D objects. Int J Comput Vis 73:263–284. https://doi.org/10.1007/s11263-006-9967-1

    Article  Google Scholar 

  22. Ren X, Sun M, Zhang X, Liu L (2017) A simplified method for UAV multispectral images mosaicking. Remote Sens 9. https://doi.org/10.3390/rs9090962

  23. Rosten E, Drummond T (2005) Fusing points and lines for high performance tracking. In: Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2005.104

  24. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2011.6126544

  25. Sasi A, Yakar M (2018) Photogrammetric modelling of Hasbey Dar'Ülhuffaz (masjid) using an unmanned aerial vehicle. International Journal of Engineering and Geosciences 3(1):6–11

    Article  Google Scholar 

  26. Sun Y, Zhao L, Huang S, Yan L, Dissanayake G (2014) L2-SIFT: SIFT feature extraction and matching for large images in large-scale aerial photogrammetry. ISPRS J Photogramm Remote Sens 91:1–16. https://doi.org/10.1016/j.isprsjprs.2014.02.001

    Article  Google Scholar 

  27. Tsai CH, Lin YC (2017) An accelerated image matching technique for UAV orthoimage registration. ISPRS J Photogramm Remote Sens 128:130–145. https://doi.org/10.1016/j.isprsjprs.2017.03.017

    Article  Google Scholar 

  28. Yemenicioglu C, Kaya S, Seker DZ (2016) Accuracy of 3D (three-dimensional) terrain models in simulations. International Journal of Engineering and Geosciences 1(1):30–33

    Article  Google Scholar 

Download references

Acknowledgments

The study was supported by Istanbul Technical University Scientific Research Office (BAP) with the project number of MGA-2017-40789.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Muhammed Enes Atik.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Communicated by: H. Babaie

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Atik, M.E., Ozturk, O., Duran, Z. et al. An automatic image matching algorithm based on thin plate splines. Earth Sci Inform (2020). https://doi.org/10.1007/s12145-020-00476-3

Download citation

Keywords

  • Image matching
  • Thin plate splines
  • Unmanned aerial vehicles, RANSAC