Skip to main content

A Simple Evaluation Procedure for Range Camera Measurement Quality

  • Conference paper
  • First Online:
Book cover Advanced Concepts for Intelligent Vision Systems (ACIVS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10016))

Abstract

Range cameras suffer from both systematic and random errors. We present a procedure to evaluate both types of error separately in one test. To quantify the systematic errors, we use an industrial robot to provide a ground truth motion of the range sensor. We present an error metric that compares this ground truth motion with the calculated motion, using the range data of the range sensor. The only item present in the scene is a white plane that we move in different positions during the experiment. This plane is used to compute the range sensor motion for the purpose of systematic error measurement, as well as to quantify the random error of the range sensor. As opposed to other range camera evaluation experiments this method does not require any extrinsic system calibration, high quality ground truth test scene or complicated test objects. Finally, we performed the experiment for three common Time-of-flight (TOF) cameras: Kinect One, Mesa SR4500 and IFM 03D303 and compare their performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arun, K.S., Huang, T.S., Blostein, S.D.: Least-squares fitting of two 3-d point sets. IEEE Trans. Pattern Anal. Mach. Intell. 9(5), 698–700 (1987)

    Article  Google Scholar 

  2. Corti, A., Giancola, S., Mainetti, G., Sala, R.: A metrological characterization of the Kinect V2 time-of-flight camera. Robot. Auton. Syst. 75, 584–594 (2016)

    Article  Google Scholar 

  3. Eggert, D.W., Lorusso, A., Fisher, R.B.: Estimating 3-d rigid body transformations: a comparison of four major algorithms. Mach. Vis. Appl. 9(5), 272–290 (1997)

    Article  Google Scholar 

  4. Fernández-Moral, E., González-Jiménez, J., Rives, P., Arévalo, V.: Extrinsic calibration of a set of range cameras in 5 seconds without pattern. In: International Conference on Intelligent Robots and Systems. IEEE/RSJ, September 2014

    Google Scholar 

  5. Fischler, M., Bolles, R.: Random sampling consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–385 (1981)

    Article  MathSciNet  Google Scholar 

  6. Hoffman, K., Kunze, R.A.: Linear algebra. Prentice-Hall Mathematics Series. Prentice-Hall, Englewood Cliffs (1971)

    MATH  Google Scholar 

  7. Khoshelham, K., Elberink, S.O.: Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 12(2), 1437–1454 (2012)

    Article  Google Scholar 

  8. Mao, J., Huang, X., Jiang, L.: A flexible solution to AX=XB for robot hand-eye calibration. In: Proceedings of the 10th WSEAS International Conference on Robotics, Control and Manufacturing Technology, ROCOM 2010, pp. 118–122. World Scientific and Engineering Academy and Society (WSEAS), Stevens Point (2010)

    Google Scholar 

  9. Pathak, K., Birk, A., Vaškevičius, N., Poppinga, J.: Fast registration based on noisy planes with unknown correspondences for 3-d mapping. Trans. Rob. 26(3), 424–441 (2010)

    Article  Google Scholar 

  10. Petersen, K.B. Pedersen, M.S.: The Matrix Cookbook. Technical University of Denmark, Version 20121115, November 2012

    Google Scholar 

  11. Pottmann, H., Wallner, J.: Computational Line Geometry. Springer-Verlag New York, Inc., Secaucus (2001)

    MATH  Google Scholar 

  12. Raposo, C., Barreto, J.P., Nunes, U.: Fast and accurate calibration of a kinect sensor. In: International Conference on 3D Vision. IEEE (2013)

    Google Scholar 

  13. Sels, S., Ribbens, B., Bogaerts, B., Peeters, J., Vanlanduit, S.: 3d model assisted fully automated scanning laser doppler vibrometer measurements (Submitted)

    Google Scholar 

  14. Shah, M., Eastman, R.D., Hong, T.: An overview of robot-sensor calibration methods for evaluation of perception systems. In: Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012, pp. 15–20. ACM, New York (2012)

    Google Scholar 

  15. Stoyanov, T., Louloudi, A., Andreasson, H., Lilienthal, A.J.: Comparative evaluation of range sensor accuracy in indoor environments. In: Proceedings of the 5th European Conference on Mobile Robots, ECMR 2011, pp. 19–24 (2011)

    Google Scholar 

  16. Torr, P.H.S., Zisserman, A.: Mlesac: a new robust estimator with application to estimating image geometry. Comput. Vis. Image Underst. 78(1), 138–156 (2000)

    Article  Google Scholar 

  17. Vasconcelos, F., Barreto, J.P., Nunes, U.: A minimal solution for the extrinsic calibration of a camera and a laser-rangefinder. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2097–2107 (2012)

    Article  Google Scholar 

  18. Zhang, Z.: Motion, structure from two perspective views: algorithms, error analysis, and error estimation. IEEE Trans. Pattern Anal. Mach. Intell. 11(5), 451–476 (1989)

    Article  Google Scholar 

Download references

Acknowledgements

The first author holds a PHD grant from the research Fund-Flanders (FWO Vlaanderen). This research has also been funded by the government agency Flanders Innovation & Entrepreneurship (VLAIO) by the support to the TETRA project Smart data clouds with project number 140336 and the Research Council of University of Antwerp (Stim-KP 31128 & the Research Committee of the Faculty of applied engineering fti-OZC).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Boris Bogaerts .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Bogaerts, B., Penne, R., Sels, S., Ribbens, B., Vanlanduit, S. (2016). A Simple Evaluation Procedure for Range Camera Measurement Quality. In: Blanc-Talon, J., Distante, C., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2016. Lecture Notes in Computer Science(), vol 10016. Springer, Cham. https://doi.org/10.1007/978-3-319-48680-2_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48680-2_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48679-6

  • Online ISBN: 978-3-319-48680-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics