Computational Methods for Selective Acquisition of Depth Measurements: An Experimental Evaluation

  • Pierre Payeur
  • Phillip Curtis
  • Ana-Maria Cretu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8192)


Acquisition of depth and texture with vision sensors finds numerous applications for objects modeling, man-machine interfaces, or robot navigation. One challenge resulting from rich textured 3D datasets resides in the acquisition, management and processing of the large amount of data generated, which often preempts full usage of the information available for autonomous systems to make educated decisions. Most subsampling solutions to reduce dataset’s dimension remain independent from the content of the model and therefore do not optimize the balance between the richness of the measurements and their compression. This paper experimentally evaluates the performance achieved with two computational methods that selectively drive the acquisition of depth measurements over regions of a scene characterized by higher 3D features density, while capitalizing on the knowledge readily available in previously acquired data. Both techniques automatically establish which subsets of measurements contribute most to the representation of the scene, and prioritize their acquisition. The algorithms are validated on datasets acquired from two different RGB-D sensors.


3D imaging depth measurement RGB-D cameras computational intelligence selective sampling neural gas 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Weiss, L.G.: Autonomous Robots in the Fog of War. IEEE Spectrum, 30-34 & 56-57 (2011)Google Scholar
  2. 2.
    Cretu, A.-M., Payeur, P., Petriu, E.M.: Selective Range Data Acquisition Driven by Neural Gas Networks. IEEE Trans. on Instrumentation and Measurement 58(8), 2634–2642 (2009)CrossRefGoogle Scholar
  3. 3.
    Curtis, P., Payeur, P.: A Method for Dynamic Selection of Optimal Depth Measurements Acquisition with Random Access Range Sensors. In: Canadian Conf. on Computer and Robot Vision, pp. 311–318 (2013)Google Scholar
  4. 4.
    Bohling, G.: Kriging, University of Kansas,
  5. 5.
    Pauly, M., Gross, M., Kobbelt, L.P.: Efficient Simplification of Point-Sampled Surfaces. IEEE Conf. on Vizualization, 163–170 (2002)Google Scholar
  6. 6.
    Uesu, D., Bavoil, L., Fleishman, S., Shepherd, J., Silva, C.T.: Simplification of Unstructured Tetrahedral Meshes by Point Sampling. In: Groller, E., Fujishio, I. (eds.) IEEE Intl. Workshop on Volume Graphics, pp. 157–238 (2005)Google Scholar
  7. 7.
    Nehab, D., Shilane, P.: Stratified Point Sampling of 3D Models, Eurographics. In: Alexa, M., Rusinkiewicz, S. (eds.) Symp. on Point-Based Graphics, pp. 49–56 (2004)Google Scholar
  8. 8.
    Kalaiah, A., Varshney, A.: Statistical Point Geometry.Eurographics. In: Kobbely, K., Schroder, P., Hoppe, H. (eds.) Symp. on Geometry Processing, pp. 107–115 (2003)Google Scholar
  9. 9.
    Pai, D.K., van der Doel, K., James, D.L., Lang, J., Lloyd, J.E., Richmond, J.L., Yau, S.H.: Scanning Physical Interaction Behavior of 3D Objects. Computer Graphics and Interactive Techniques, 87-96 (2001)Google Scholar
  10. 10.
    Lang, J., Pai, D.K., Woodham, R.J.: Acquisition of Elastic Models for Interactive Simulation. Intl. Journal of Robotics Research 21(8), 713–733 (2002)CrossRefGoogle Scholar
  11. 11.
    Shih, C.S., Gerhardt, L.A., Williams, C.-C., Lin, C., Chang, C.-H., Wan, C.-H., Koong, C.-S.: Non-uniform Surface Sampling Techniques for Three-dimensional Object Inspection. Optical Engineering 47(5), 053606 (2008)CrossRefGoogle Scholar
  12. 12.
    Connolly, C.I.: The Determination of Next Best Views. In: IEEE Intl. Conf. on Robotics and Automation, pp. 432–435 (1985)Google Scholar
  13. 13.
    Sequeira, V., Goncalves, J.G.M., Ribeiro, M.I.: Active View Selection for Efficient 3D Scene Reconstruction. In: IEEE Intl. Conf. on Pattern Recognition, vol. 1, pp. 815–819 (1996)Google Scholar
  14. 14.
    Maver, J., Bajcsy, R.: Occlusions as a Guide for Planning the Next View. IEEE Trans. on Pattern Analysis and Machine Intelligence 15(5), 417–433 (1993)CrossRefGoogle Scholar
  15. 15.
    Morooka, K., Zha, H., Hasegawa, T.: Computations on a Spherical View Space for Efficient Planning of Viewpoints in 3-D Object Modeling. In: IEEE Intl Conf. on 3-D Digital Imaging and Modeling, pp. 138–147 (1999)Google Scholar
  16. 16.
    MacKinnon, D., Aitken, V., Blais, F.: Adaptive Laser Range Scanning using Quality Metrics. In: IEEE Instrumentation and Measurement Technology Conf., pp. 348–353 (2008)Google Scholar
  17. 17.
    Ho, C., Saripalli, S.: Where Do You Sample? - An Autonomous Underwater Vehicle Story. In: IEEE Intl. Symposium on Robotic and Sensors Environments, pp. 119–124 (2011)Google Scholar
  18. 18.
    English, C., Okouneva, G., Saint-Cyr, P., Choudhuri, A., Luu, T.: Real-Time Dynamic Pose Estimation Systems in Space: Lessons Learned for System Design and Performance Evaluation. Intl. Journal of Intelligent Control and Systems 16(2), 79–96 (2011)Google Scholar
  19. 19.
    Martinetz, T.M., Berkovich, S.G., Schulten, K.J.: Neural-Gas Network for Vector Quantization and its Application to Time-Series Prediction. IEEE Trans. on Neural Networks 4(4), 558–568 (1993)CrossRefGoogle Scholar
  20. 20.
    Khoshelham, K.: Accuracy Analysis of Kinect Depth Data. In: ISPRS Workshop Laser Scanning (2011)Google Scholar
  21. 21.
    Macknojia, R., Chávez-Aragón, A., Payeur, P., Laganière, R.: Experimental Characterization of Two Generations of Kinect’s Depth Sensors. In: IEEE Intl. Symposium on Robotic and Sensors Environments, pp. 150–155 (2012)Google Scholar
  22. 22.
    Boyer, A., Curtis, P., Payeur, P.: 3D Modeling from Multiple Views with Integrated Registration and Data Fusion. In: Canadian Conf. on Computer and Robot Vision, pp. 252–259 (2009)Google Scholar
  23. 23.
    Boyer, A.: Adaptive Structured Light Imaging for 3D Reconstruction and Autonomous Robotic Exploration, University of Ottawa. Thesis (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Pierre Payeur
    • 1
  • Phillip Curtis
    • 1
  • Ana-Maria Cretu
    • 2
  1. 1.School of Electrical Engineering and Computer ScienceUniversity of OttawaOttawaCanada
  2. 2.Department of Computer Science and EngineeringUniversité du Québec en OutaouaisGatineauCanada

Personalised recommendations