Abstract
To build an Augmented Reality (AR) application it is necessary to recognize a fiducial marker, then to calibrate the camera that is viewing the 3D scene on the marker, and finally to draw a virtual object over the image taken by the camera but in the virtual coordinate system supposed also on the fiducial marker. The camera calibration step give us the transformation matrix from 3D world to 2D on the screen, and the pose of the marker with respect to the virtual coordinate system. An AR application must run interactively with the user, and also in real time. Performing all these calculations in a embedded device such as a Single Board Computer (SBC), a tablet, or a smartphone, is a challenge because a normal numerical analysis library is huge, and it is not designed for such devices. In this article we present a lightweight numerical library, it has been developed thinking in such computing restricted devices. We show results on two AR applications developed for the Raspberry Pi 3 SBC.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Camera model v2 documentation. https://www.raspberrypi.org/documentation/hardware/camera/. Accessed 9 Oct 2017
Open source computer vision library (OpenCV). http://opencv.org. Accessed 18 Sept 2017
Billinghurst, M., Dünser, A.: Augmented reality in the classroom. IEEE Mag. Comput. 45, 56–63 (2012)
Di Serio, A., Blanca Ibáñez, M., Delgado Kloos, C.: Impact of an augmented reality system on students motivation for a visual art course. Comput. Educ. 68, 586–596 (2013)
Fitzgibbon, A., Pilu, M., Fisher, R.: Direct least square fitting of ellipses. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 476–480 (1999). https://doi.org/10.1109/34.765658
de la Fraga, L., Cruz Díaz, C.: Fitting an ellipse is equivalent to find the roots of a cubic equation. In: 2011 8th International Conference on Electrical Engineering, Computer Science and Automatic Control, pp. 1–4. IEEE (2011)
Gervautz, M., Schmalstieg, D.: Anywhere interfaces using handheld augmented reality. IEEE Mag. Comput. 45, 26–31 (2012)
Golub, G., Van Loan, F.: Matrix Computations, 3rd edn. The Johns Hopkins University Press, Baltimore (1996)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2003)
Kim, J.S., Gurdjos, P., Kweon, I.S.: Geometric and algebraic constraints of projected concentric circles and their applications to camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 27(4), 637–642 (2005)
Kneip, L., Scaramuzza, D., Siegwart, R.: A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)(2011). https://doi.org/10.1109/CVPR.2011.5995464
Kopp, J.: Efficient numerical diagonalization of hermitian \(3\times 3\) matrices. Int. J. Mod. Phys. C 19, 523–548 (2008)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Zheng, Y., Kuang, Y., Sugimoto, S., Astrom, K., Okutomi, M.: Revisiting the PnP problem: a fast, general and optimal solution. In: The IEEE International Conference on Computer Vision (ICCV), December 2013
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
de la Fraga, L.G., García-Morales, N.A., Jaramillo-Olivares, D., Ramírez-Díaz, A.J. (2018). A Lightweight Library for Augmented Reality Applications. In: Martínez-Trinidad, J., Carrasco-Ochoa, J., Olvera-López, J., Sarkar, S. (eds) Pattern Recognition. MCPR 2018. Lecture Notes in Computer Science(), vol 10880. Springer, Cham. https://doi.org/10.1007/978-3-319-92198-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-92198-3_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92197-6
Online ISBN: 978-3-319-92198-3
eBook Packages: Computer ScienceComputer Science (R0)
