Advertisement

An interactive cameraless projector calibration method

  • Cristina Portalés
  • Pablo Casanova-Salas
  • Sergio Casas
  • Jesús Gimeno
  • Marcos Fernández
Original Article

Abstract

The geometric calibration of projectors is a demanding task in many areas related to computer vision, virtual reality or augmented reality, to name some. Up to date, different methods have been proposed to retrieve the intrinsic and extrinsic parameters of projectors. During the last 20 years, researchers have used cameras as means to calibrate projectors in order to automatize the process. However, this might add: (1) complexity in terms of mathematical formulation; (2) restrictions in terms of camera locations relative to projectors; and (3) additional errors (those due to the camera calibration itself). Most of these camera-based methods make use of planar homographies, and others require an extended calibration process (for both the camera and the projector). In this paper, we present an approach that combines a direct transformation method (DLT) with projected augmented reality to perform an interactive calibration of projectors without the need for cameras. This method is based on non-coplanar points and 2D/3D correspondences, which are interactively established. Intrinsic and extrinsic calibration is achieved in a single step, making use of the DLT. The method rescues old approaches to calibrate projectors, but brings the new capabilities of interactive systems, all integrated in a single software solution. We conduct different experiments by considering two projector setups and two different sets of control points, proving that the accuracy of the method in the real space can be between one and two pixels.

Keywords

Projector Calibration Augmented reality DLT Interactive Photogrammetry Cameraless 

Notes

References

  1. Ashdown M, Sato Y (2005) Steerable projector calibration. In: Computer vision and pattern recognition—workshops, 2005. IEEE computer society conference on CVPR workshops, p 8.  https://doi.org/10.1109/cvpr.2005.533
  2. Axholt M et al. (2010) Optical see-through head mounted display direct linear transformation calibration robustness in the presence of user alignment noise. In: Proceedings of the human factors and ergonomics society annual meeting, vol 28. SAGE Publications Sage CA: Los Angeles, pp 2427–2431Google Scholar
  3. Bimber O, Raskar R (2005) Spatial augmented reality: merging real and virtual worlds. CRC Press, Boca RatonCrossRefGoogle Scholar
  4. Brown M, Majumder A, Yang R (2005) Camera-based calibration techniques for seamless multiprojector displays. IEEE Trans Vis Comput Gr 11:193–206.  https://doi.org/10.1109/tvcg.2005.27 CrossRefGoogle Scholar
  5. Chen H, Sukthankar R, Wallace G, Li K (2002) Scalable alignment of large-format multi-projector displays using camera homography trees. In: Visualization, 2002. VIS 2002. IEEE, pp 339–346.  https://doi.org/10.1109/visual.2002.1183793
  6. Chen B-S, Zhong Q, Li H-F, Liu X, Xu H-S (2014) Automatic geometrical calibration for multiprojector-type light field three-dimensional display. OPTICE 53:073107.  https://doi.org/10.1117/1.oe.53.7.073107 CrossRefGoogle Scholar
  7. Chen R, Xu J, Chen H, Su J, Zhang Z, Chen K (2016) Accurate calibration method for camera and projector in fringe patterns measurement system. Appl Opt 55:4293–4300.  https://doi.org/10.1364/ao.55.004293 CrossRefGoogle Scholar
  8. Chien HJ, Chen CY, Chen CF (2010) A target-adapted geometric calibration method for camera-projector system. In: 2010 25th international conference of image and vision computing New Zealand (IVCNZ), 2010, pp 1–8.  https://doi.org/10.1109/ivcnz.2010.6148842
  9. Deglint J, Cameron A, Scharfenberger C, Sekkati H, Lamm M, Wong A, Clausi DA (2016) Auto-calibration of a projector–camera stereo system for projection mapping. J Soc Inf Disp 24:510–520.  https://doi.org/10.1002/jsid.464 CrossRefGoogle Scholar
  10. Dermanis A (1994) Free network solutions with the direct linear transformation method. ISPRS J Photogramm Remote Sens 49:2–12CrossRefGoogle Scholar
  11. Fernandez S, Salvi J (2011) Planar-based camera-projector calibration. In: 2011 7th international symposium on image and signal processing and analysis (ISPA), 2011, pp 633-638Google Scholar
  12. Gockel T, Azad P, Dillmann R (2004) Calibration issues for projector-based 3D-scanning. In: Proceedings of shape modeling applications, 2004. IEEE, pp 367–370Google Scholar
  13. Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press, CambridgezbMATHGoogle Scholar
  14. Harville M, Culbertson B, Sobel I, Gelb D, Fitzhugh A, Tanguay D (2006) Practical methods for geometric and photometric correction of tiled projector. In: Conference on computer vision and pattern recognition workshop, 2006. CVPRW ‘06, p 5.  https://doi.org/10.1109/cvprw.2006.161
  15. Hong W, Gelb D, Trott M (2012) Automatic calibration of a projector-camera system with a see-through screen. In: 2012 19th IEEE international conference on image processing (ICIP), 2012 pp 337–340.  https://doi.org/10.1109/icip.2012.6466864
  16. Huang Z, Xi J, Yu Y, Guo Q (2015) Accurate projector calibration based on a new point-to-point mapping relationship between the camera and projector images. Appl Opt 54:347–356.  https://doi.org/10.1364/ao.54.000347 CrossRefGoogle Scholar
  17. Kimura M, Mochimaru M, Kanade T (2007) Projector calibration using arbitrary planes and calibrated camera. In: IEEE conference on computer vision and pattern recognition, 2007. CVPR ‘07, pp 1–2.  https://doi.org/10.1109/cvpr.2007.383477
  18. Knyaz VA (2006) Automated calibration technique for photogrammetric system based on a multi-media projector and a CCD Camera. In: Maas H-G, Schneider D (eds.) Proceedings of the ISPRS commission V symposium image engineering and vision metrology, Dresden, GermanyGoogle Scholar
  19. Kraus K (1997) Photogrammetry. Advanced methods and applications, vol 2. Dümmler/Bonn, GermanyGoogle Scholar
  20. Liao J, Cai L (2008) A calibration method for uncoupling projector and camera of a structured light system. In: IEEE/ASME international conference on advanced intelligent mechatronics, 2008. AIM 2008, Xian, China, pp 770–774.  https://doi.org/10.1109/aim.2008.4601757
  21. MadMapper (2017) MadMapper—The Mapping Software. https://madmapper.com/. Accessed 02 July 2018
  22. Martynov I, Kamarainen J-K, Lensu L (2011) Projector calibration by “inverse camera calibration”. In: Scandinavian conference on image analysis, Springer, pp 536–544Google Scholar
  23. Moreno D, Taubin G (2012) Simple, accurate, and robust projector-camera calibration. In: 2012 Second international conference on 3D imaging, modeling, processing, visualization and transmission (3DIMPVT), Zürich, Switzerland, pp 464–471.  https://doi.org/10.1109/3dimpvt.2012.77
  24. Okatani T, Deguchi K (2006) Autocalibration of an Ad Hoc construction of multi-projector displays. In: Conference on computer vision and pattern recognition workshop, 2006. CVPRW ‘06, New York, NY, USA, p 8.  https://doi.org/10.1109/cvprw.2006.35
  25. Orghidan R, Salvi J, Gordan M, Florea C, Batlle J (2014) Structured light self-calibration with vanishing points. Mach Vis Appl 25:489–500.  https://doi.org/10.1007/s00138-013-0517-x CrossRefGoogle Scholar
  26. Park S-Y, Park GG Active calibration of camera-projector systems based on planar homography. In: 2010 20th international conference on pattern recognition (ICPR), pp 320–323.  https://doi.org/10.1109/icpr.2010.87
  27. Portalés C, Ribes-Gómez E, Pastor B, Gutiérrez A (2015) Calibration of a camera–projector monochromatic system. Photogramm Rec 30:82–99.  https://doi.org/10.1111/phor.12094 CrossRefGoogle Scholar
  28. Portalés C, Casas S, Coma I, Fernández M (2017) A multi-projector calibration method for virtual reality simulators with analytically defined screens. J Imaging 3:19CrossRefGoogle Scholar
  29. Portalés C, Orduña JM, Morillo P, Gimeno J (2018) An efficient projector calibration method for projecting virtual reality on cylindrical surfaces. Multimed Tools Appl.  https://doi.org/10.1007/s11042-018-6253-5 Google Scholar
  30. Qi W, Li F, Zhenzhong L (2010) Review on camera calibration. In: 2010 Chinese control and decision conference (CCDC). IEEE, pp 3354–3358Google Scholar
  31. Qian L, Winkler A, Fuerst B, Kazanzides P, Navab N (2016) Modeling physical structure as additional constraints for stereoscopic optical see-through head-mounted display calibration. In: 2016 IEEE international symposium on mixed and augmented reality (ISMAR-Adjunct), pp 154–155.  https://doi.org/10.1109/ismar-adjunct.2016.0065
  32. Raij A, Pollefeys M (2004) Auto-calibration of multi-projector display walls. In: Proceedings of the 17th international conference on pattern recognition. ICPR 2004, vol. 11. pp 14–17.  https://doi.org/10.1109/icpr.2004.1333994
  33. Raskar R et al (1999) Multi-projector displays using camera-based registration. In: Proceedings of visualization ‘99, pp 161–522.  https://doi.org/10.1109/visual.1999.809883
  34. Sajadi B, Majumder A (2009) Markerless view-independent registration of multiple distorted projectors on extruded surfaces using an uncalibrated camera. IEEE Trans Visual Comput Gr 15:1307–1316.  https://doi.org/10.1109/tvcg.2009.166 CrossRefGoogle Scholar
  35. Sajadi B, Majumder A (2010) Auto-calibration of cylindrical multi-projector systems. In: 2010 IEEE virtual reality conference (VR), Waltham, Massachusetts, USA, pp 155–162.  https://doi.org/10.1109/vr.2010.5444797
  36. Sun W, Sobel I, Culbertson B, Gelb D, Robinson I (2008) Calibrating multi-projector cylindrically curved displays for “wallpaper” projection. In: Paper presented at the proceedings of the 5th ACM/IEEE international workshop on projector camera systems, Marina del Rey, CaliforniaGoogle Scholar
  37. Tao J, Zhang J, Zhang Z (2004) Calibration of a projector with a planar grid ISPRS. Istanbul, TurkeyGoogle Scholar
  38. Tardif JP, Roy S, Trudeau M (2003) Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction. In: Proceedings Fourth international conference on 3-D digital imaging and modeling, 3DIM 2003, pp 217–224.  https://doi.org/10.1109/im.2003.1240253
  39. Zhang J, Tao J, Zhang Z A flexible technique for slide projector calibration. In: Third international symposium on multispectral image processing and pattern recognition, 2003. International Society for Optics and Photonics, pp 187–191Google Scholar
  40. Zhang B, Li YF, Wu YH (2007) Self-recalibration of a structured light system via plane-based homography. Pattern Recogn 40:1368–1377.  https://doi.org/10.1016/j.patcog.2006.04.001 CrossRefzbMATHGoogle Scholar
  41. Zhang X, Zhang Z, Cheng W (2015) Iterative projector calibration using multi-frequency phase-shifting method. In: 2015 IEEE 7th international conference on cybernetics and intelligent systems (CIS) and IEEE conference on robotics, automation and mechatronics (RAM), pp 1–6.  https://doi.org/10.1109/iccis.2015.7274538
  42. Zhao L, Weng D, Li D (2014) The auto-geometric correction of multi-projector for cylindrical surface using Bézier patches. J Soc Inform Display 22:473–481.  https://doi.org/10.1002/jsid.264 CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.Institute of Robotics and Information and Communication Technologies (IRTIC)Universitat de ValènciaValenciaSpain

Personalised recommendations