Skip to main content

An Automatic Thermal and Visible Image Registration Using a Calibration Rig

  • Chapter
  • First Online:
Recent Trends in Image and Signal Processing in Computer Vision

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1124))

Abstract

Registration of thermal and visible image is a prominent prerequisite for the various medical and industrial image processing. Due to the different imaging principles, the contrast variation and texture are different in the thermal and visible image. In such cases, the automatic registration of thermal and visible image is a crucial step. In this paper, an automatic calibration rig-based registration algorithm is proposed. The calibration rig is used to extract the correspondence pairs in both images. The proposed algorithm finds the corner and centroid of the square in calibration rig which has the same position in world coordinates and same characteristic in thermal and visible image. Experimental results show that the proposed approach is good for the automatic registration without any human intervention.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. S.G. Kong, J. Heo, F. Boughorbel, Y. Zheng, B.R. Abidi, A. Koschan, M. Yi, M.A. Abidi, Multiscale fusion of visible and thermal IR images for Illumination-invariant face recognition. Int. J. Comput. Vis. 71(2), 215–233 (2007). https://doi.org/10.1007/s11263-006-6655-0

    Article  Google Scholar 

  2. J. Ma, Y. Ma, C. Li, Infrared and visible image fusion methods and applications: a survey. Inf. Fusion 45, 153–178 (2019). https://doi.org/10.1016/j.inffus.2018.02.004

    Article  Google Scholar 

  3. L.G. Brown, A survey of image registration techniques. ACM Comput. Surv. 24(4), 325–376 (1992). https://doi.org/10.1145/146370.146374

    Article  Google Scholar 

  4. B. Zitová, J. Flusser, Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003). https://doi.org/10.1016/S0262-8856(03)00137-9

    Article  Google Scholar 

  5. J.P.W. Pluim, J.B.A. Maintz, M.A. Viergever, Image registration by maximization of combined mutual information and gradient information. IEEE Trans. Med. Imaging 19(8), 809–814 (2000). https://doi.org/10.1109/42.876307

    Article  Google Scholar 

  6. C. Studholme, D.L.G. Hill, D.J. Hawkes, An overlap invariant entropy measure of 3D medical image alignment. Pattern Recogn. 32(1), 71–86 (1999). https://doi.org/10.1016/S0031-3203(98)00091-0

    Article  Google Scholar 

  7. J. Ma, J. Zhao, J. Tian, A.L. Yuille, Z. Tu, Robust point matching via vector field consensus. IEEE Trans. Image Process. 23(4), 1706–1721 (2014). https://doi.org/10.1109/TIP.2014.2307478

    Article  MathSciNet  MATH  Google Scholar 

  8. D.G. Lowe, Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004). https://doi.org/10.1023/B:VISI.0000029664.99615.94

    Article  Google Scholar 

  9. J. Chen, J. Tian, N. Lee, J. Zheng, R.T. Smith, A.F. Laine, A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Trans. Biomed. Eng. 57(7), 1707–1718 (2010). https://doi.org/10.1109/TBME.2010.2042169

    Article  Google Scholar 

  10. C.G. Harris, M. Stephens, A combined corner and edge detector, in Citeseer (1988), pp 10–5244

    Google Scholar 

  11. H. Bay, A. Ess, T. Tuytelaars, L. Van Gool, Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008). https://doi.org/10.1016/j.cviu.2007.09.014

    Article  Google Scholar 

  12. C. Aguilera, F. Barrera, F. Lumbreras, A.D. Sappa, R. Toledo, Multispectral image feature points. Sensors 12(9) (2012). https://doi.org/10.3390/s120912661

    Article  Google Scholar 

  13. T. Mouats, N. Aouf, A.D. Sappa, C. Aguilera, R. Toledo, Multispectral stereo odometry. IEEE Trans. Intell. Transp. Syst. 16(3), 1210–1224 (2015). https://doi.org/10.1109/TITS.2014.2354731

    Article  Google Scholar 

  14. Y. Ye, L. Shen, M. Hao, J. Wang, Z. Xu, Robust optical-to-SAR image matching based on shape properties. IEEE Geosci. Remote Sens. Lett. 14(4), 564–568 (2017). https://doi.org/10.1109/LGRS.2017.2660067

    Article  Google Scholar 

  15. M. Lalit, M. Prasant Kumar, K. Amod, A fusion of cuckoo search and multiscale adaptive smoothing based unsharp masking for image enhancement. Int. J. Appl. Metaheuristic Comput. (IJAMC) 10(3), 151–174 (2019). https://doi.org/10.4018/IJAMC.2019070108

    Article  Google Scholar 

  16. N. Otsu, A threshold selection method from gray-level histograms. IEEE Trans. Syst., Man, Cybern. 9(1), 62–66 (1979). https://doi.org/10.1109/TSMC.1979.4310076

    Article  Google Scholar 

  17. https://in.mathworks.com/help/images/ref/cpselect.html. Accessed 10 Oct 2019

Download references

Acknowledgements

The authors would like to thank the Director, CSIR-CSIO for providing the necessary infrastructure during the investigation. This work is under the fellowship of CSIR-SRF.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Prasant Mahapatra .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Maurya, L., Mahapatra, P., Chawla, D., Verma, S. (2020). An Automatic Thermal and Visible Image Registration Using a Calibration Rig. In: Jain, S., Paul, S. (eds) Recent Trends in Image and Signal Processing in Computer Vision. Advances in Intelligent Systems and Computing, vol 1124. Springer, Singapore. https://doi.org/10.1007/978-981-15-2740-1_5

Download citation

Publish with us

Policies and ethics