Abstract
RGB-Depth (or RGB-D) cameras are increasingly being adopted for real-world applications, especially in areas of healthcare and at-home monitoring. As for any other sensor, and since the manufacturer’s parameters (e.g., focal length) might change between models, calibration is necessary to increase the camera’s sensing accuracy. In this paper, we present a novel RGB-D camera-calibration algorithm that is easy-to-use even for non-expert users at their home; our method can be used for any arrangement of RGB and depth sensors, and only requires that a spherical object (e.g., a basketball) is moved in front of the camera for a few seconds. A robust image-processing pipeline automatically detects the moving sphere and rejects noise and outliers in the image data. A novel closed-form solution is presented to accurately compute an initial set of calibration parameters which are then utilized in a nonlinear minimization stage over all the camera parameters including lens distortion. Extensive simulation and experimental results show the accuracy and robustness to outliers of our algorithm with respect to existing checkerboard-based methods. Furthermore, an RGB-D Calibration Toolbox for MATLAB is made freely available for the entire research community.
Chapter PDF
Similar content being viewed by others
References
Microsoft® Kinect Camera (2011) (Web): http://www.xbox.com/en-US/KINECT .
Konolige, K.: Projected texture stereo. In: Proc. IEEE Int. Conf. Robot. Automat. In: Proc. IEEE Int. Conf. Robot. Automat, Anchorage, Alaska, U.S, pp. 148–155 (May 2010)
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: Int. Conf. Vis. Pattern Rec. (2011)
Newcombe, R., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A., Kohli, P., Shotton, J., Hodges, S., Fitzgibbon, A.: KinectFusion: Real-time dense surface mapping and tracking. In: 10th IEEE Intl. Sym. on Mixed and Aug. Real., pp. 127–136 (2011)
Morbidi, F., Ray, C., Mariottini, G.L.: Cooperative active target tracking for heterogeneous robots with application to gait monitoring. In: Proc. IEEE Int. Conf. Intell. Rob. Sys., pp. 3608–3613 (September 2011)
Gabel, M., Gilad-Bachrach, R., Renshaw, E., Schuster, A.: Full body gait analysis with kinect. In: Intl. Conf. of the IEEE Eng. in Med. and Bio. Soc. (August 2012)
Cai, Q., Gallup, D., Zhang, C., Zhang, Z.: 3D Deformable Face Tracking with a Commodity Depth Camera. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 229–242. Springer, Heidelberg (2010)
Frank, B., Schmedding, R., Stachniss, C., Teschner, M., Burgard, W.: Learning Deformable Object Models for Mobile Robot Navigation using Depth Cameras and a Manipulation Robot. In: Proc. Robotics: Science and Systems VI’s Workshop on RGB-D: Advanced Reasoning with Depth Cameras (June 2010)
Lai, K., Bo, L., Ren, X., Fox, D.: A Large-Scale Hierarchical Multi-View RGB-D Object Dataset. In: Proc. IEEE Int. Conf. Robot. Automat, pp. 1817–1824 (May 2011)
Ramey, A., Gonzalez-Pacheco, V., Salichs, M.A.: Integration of a low-cost RGB-D sensor in a social robot for gesture recognition. In: Proc. 6th Int. Conf. Human-robot Inter., Lausanne, Switzerland, pp. 229–230 (March 2011)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge Univ. Press (2003)
Burrus, N.: Kinect calibration (Web): http://nicolas.burrus.name/index.php/Research/KinectCalibration
Mihelich, P., Konolige, K.: Technical description of kinect calibration (Web): http://www.ros.org/wiki/kinect_calibration/technical
Jung, J., Jeong, Y., Park, J., Ha, H., Kim, D.J., Kweon, I.: A Novel 2.5D Pattern for Extrinsic Calibration of ToF and Camera Fusion System. In: Proc. IEEE/RSJ Intl. Conf. on Intel. Rob. Syst., pp. 3290–3296 (September 2011)
Smisek, J., Jancosek, M., Pajdla, T.: 3D with kinect. In: IEEE Intl. Conf. on Computer Vision Workshops, pp. 1154–1160 (November 2011)
Zhang, C., Zhang, Z.: Calibration between Depth and Color Sensors for Commodity Depth Cameras. In: Intl. Workshop on Hot Topics in 3D, in Conjunction with ICME (July 2011)
Herrera, C., Kannala, J., Heikkilä, J.: Joint depth and color camera calibration with distortion correction. IEEE Trans. Pattern Anal. 34(10), 2058–2064 (2012)
Khoshelham, K., Elberink, S.O.: Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications. Sensors 12(2), 1437–1454 (2012)
Mihelich, P.: ROS openni-launch package for Intrin. and Extrin. Kinect Calib (2013), (Web): http://www.ros.org/wiki/openni_launch/Tutorials/
Fischler, M.A., Bolles, R.C.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Commun. ACM 24, 381–395 (1981)
Cipolla, R., Giblin, P.: Visual motion of curves and surfaces. Cambridge University Press, New York (2000)
Canny, J.: A Computational Approach to Edge Detection. IEEE Trans. Pattern Anal. 8(6), 679–698 (1986)
Ballard, D.H.: Generalizing the Hough Transform to Detect Arbitrary Shapes. Pattern Recog. 13(2), 111–122 (1981)
Fitzgibbon, A., Pilu, M., Fisher, R.B.: Direct least square fitting of ellipses. IEEE Trans. Pattern Anal. 21(5), 476–480 (1999)
Halıř, R., Flusser, J.: Numerically stable direct least squares fitting of ellipses. In: Proc. 6th Int. Conf. Cen. Eur. on Com. Graph. Vis., vol. 21(5), pp. 125–132 (Febraury 1998)
Wong, K., Zhang, G., Chen, Z.: A Stratified Approach for Camera Calibration Using Spheres. IEEE Trans. on Img. Proc. 20(2), 305–316 (2011)
Staranowicz, A., Mariottini, G.L.: A comparative study of calibration methods for kinect-style cameras. In: Proc. 5th Intl. Conf on PETRAE, pp. 49:1–49:4 (2012)
Camera Calibration Toolbox for Matlab (2010) (Web): http://www.vision.caltech.edu/bouguetj/calib_doc/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Staranowicz, A., Brown, G.R., Morbidi, F., Mariottini, G.L. (2014). Easy-to-Use and Accurate Calibration of RGB-D Cameras from Spheres. In: Klette, R., Rivera, M., Satoh, S. (eds) Image and Video Technology. PSIVT 2013. Lecture Notes in Computer Science, vol 8333. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-53842-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-53842-1_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-53841-4
Online ISBN: 978-3-642-53842-1
eBook Packages: Computer ScienceComputer Science (R0)