Abstract
Active view planning for gathering data from an unexplored 3D complex scenario is a hard and still open problem in the computer vision community. In this paper, we present a general task-oriented approach based on an information-gain maximization that easily deals with such a problem. Our approach consists of ranking a given set of possible actions, based on their task-related gains, and then executing the best-ranked action to move the required sensor.
An example of how our approach behaves is demonstrated by applying it over 3D raw data for real-time volume modelling of complex-shaped objects. Our setting includes a calibrated 3D time-of-flight (ToF) camera mounted on a 7 degrees of freedom (DoF) robotic arm. Noise in the sensor data acquisition, which is too often ignored, is here explicitly taken into account by computing an uncertainty matrix for each point, and refining this matrix each time the point is seen again. Results show that, by always choosing the most informative view, a complete model of a 3D free-form object is acquired and also that our method achieves a good compromise between speed and precision.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alenyà, G., Dellen, B., Torras, C.: 3D modelling of leaves from color and tof data for robotized plant measuring. In: Proc. IEEE Int. Conf. Robot. Automat., Shanghai, pp. 3408–3414 (May 2011)
Chen, S., Li, Y., Zhang, J., Wang, W.: Active sensor planning for multiview vision tasks. Springer, Heidelberg (2008)
Deinzer, F., Derichs, C., Niemann, H.: A framework for actively selecting viewpoints in object recognition. Int. J. Pattern Recogn. Artif. Intell. 23(4), 765–799 (2009)
Foix, S., Alenyà, G., Andrade-Cetto, J., Torras, C.: Object modeling using a ToF camera under an uncertainty reduction approach. In: Proc. IEEE Int. Conf. Robot. Automat., Anchorage, pp. 1306–1312 (May 2010)
Foix, S., Alenyà, G., Torras, C.: Lock-in Time-of-Flight (ToF) cameras: a survey. IEEE Sensors J. 11(9), 1917–1926 (2011)
Foix, S., Alenyà, G., Torras, C.: Towards plant monitoring through next best view. In: Proc. 14th Int. Conf. Cat. Assoc. Artificial Intelligence, Lleida (October 2011)
Fuchs, S., Hirzinger, G.: Extrinsic and depth calibration of ToF-cameras. In: Proc. 22nd IEEE Conf. Comput. Vision Pattern Recog., Anchorage, vol. 1-12, pp. 3777–3782 (June 2008)
Fuchs, S., May, S.: Calibration and registration for precise surface reconstruction with time of flight cameras. Int. J. Int. Syst. Tech. App. 5(3-4), 274–284 (2008)
Jia, Z., Chang, Y., Chen, T.: A general boosting-based framework for active object recognition. In: Proc. British Machine Vision Conf., pp. 46.1–46.11. BMVA Press (September 2010)
Kriegel, S., Bodenmüller, T., Suppa, M., Hirzinger, G.: A surface-based next-best-view approach for automated 3D model completion of unknown objects. In: Proc. IEEE Int. Conf. Robot. Automat., Shanghai, pp. 4869–4874 (May 2011)
Madsen, C., Christensen, H.: A viewpoint planning strategy for determining true angles on polyhedral objects by camera alignment. IEEE Trans. Pattern Anal. Machine Intell. 19(2), 158–163 (1997)
Maver, J., Bajcsy, R.: Occlusions as a guide for planning the next view. IEEE Trans. Pattern Anal. Machine Intell. 15(5), 417–433 (1993)
May, S., Droeschel, D., Holz, D., Fuchs, S., Malis, E., Nuchter, A., Hertzberg, J.: Three-dimensional mapping with time-of-flight cameras. J. Field Robotics 26(11-12), 934–965 (2009)
Ramisa, A., Alenyà, G., Moreno-Noguer, F., Torras, C.: Determining where to grasp cloth using depth information. In: Proc. 14th Int. Conf. Cat. Assoc. Artificial Intelligence, Lleida (October 2011)
Roy, S.D., Chaudhury, S., Banerjee, S.: Active recognition through next view planning: A survey. Pattern Recogn. 37(3), 429–446 (2004)
Saxena, A., Sun, M., Ng., A.Y.: Make3d: Depth perception from a single still image. In: Proc. 23th AAAI Conf. on Artificial Intelligence, Chicago, pp. 1571–1576 (July 2008)
Schiele, B., Crowley, J.: Transinformation for active object recognition. In: Proc. IEEE Int. Conf. Comput. Vision, Bombay, pp. 249–254 (January 1998)
Scott, W.R., Roth, G.: View planning for automated three-dimensional object reconstruction and inspection. ACM Computing Surveys 35(1), 64–96 (2003)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)
Sim, R.: Stable exploration for bearings-only SLAM. In: Proc. IEEE Int. Conf. Robot. Automat., Barcelona, pp. 2422–2427 (April 2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Foix, S., Kriegel, S., Fuchs, S., Alenyà, G., Torras, C. (2012). Information-Gain View Planning for Free-Form Object Reconstruction with a 3D ToF Camera. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P., Zemčík, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2012. Lecture Notes in Computer Science, vol 7517. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33140-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-33140-4_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33139-8
Online ISBN: 978-3-642-33140-4
eBook Packages: Computer ScienceComputer Science (R0)