Abstract
In this paper, the problem of 3D body registration using a single RGB-D sensor is approached. It has been guided by three main requirements: low-cost, unconstrained movement and accuracy. In order to fit them, an iterative registration method for accurately aligning data from single RGB-D sensor is proposed. The data is acquired while a person rotates in front of the camera, without the need of any external marker or constraint about its pose. The articulated alignment is carried out in a model-free approach in order to be more consistent with the real data. The iterative method is divided in stages, contributing to each other by the refinement of a specific part of the acquired data. The exploratory results validate the proposed method that is able to feed on itself in each iteration improving the final result by a progressive iteration, with the required precision under the conditions of affordability and unconstrained movement acquisition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anguelov, D., Srinivasan, P., Koller, D.: Scape: shape completion and animation of people. ACM Trans. Graph. (TOG) 24(3), 408–416 (2005)
Barmpoutis, A.: Tensor body: real-time reconstruction of the human body and avatar synthesis from RGB-D. IEEE Trans. Cybern. 43(5), 1347–1356 (2013)
Bogo, F., Black, M.J., Loper, M., Romero, J.: Detailed full-body reconstructions of moving people from monocular RGB-D sequences. In: ICCV, pp. 2300–2308 (2015)
Charles, J., Everingham, M.: Learning shape models for monocular human pose estimation from the Microsoft Xbox Kinect. In: 2011 IEEE International Conference on Computer Vision Workshops, pp. 1202–1208. IEEE (2011)
Chen, W., Wang, H., Li, Y., Su, H., Tu, C., Lischinsk, D., Cohen-Or, D., Chen, B.: Synthesizing training images for boosting human 3D pose estimation. CoRR (2016)
Cui, Y., Chang, W., Nöll, T., Stricker, D.: KinectAvatar: fully automatic body capture using a single kinect. In: Park, J.-I., Kim, J. (eds.) ACCV 2012. LNCS, vol. 7729, pp. 133–147. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37484-5_12
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: Experimental Robotics, vol. 79. Springer, Heidelberg (2014)
Lai, K., Bo, L., Ren, X., Fox, D.: Consumer depth cameras for computer vision. In: Fossati, A., Gall, J., Grabner, H., Ren, X., Konolige, K. (eds.) Consumer Depth Cameras for Computer Vision, p. 167. Springer, London (2013)
Lin, S., Chen, Y., Lai, Y.-K., Martin, R.R., Cheng, Z.-Q.: Fast capture of textured full-body avatar with RGB-D cameras (2016)
Lovato, C., Bissolo, E., Lanza, N., Stella, A., Giachetti, A.: A low cost and easy to use setup for foot scanning (2014)
Mihalyi, R.G., Pathak, K., Vaskevicius, N., Fromm, T., Birk, A.: Robust 3D object modeling with a low-cost RGBD-sensor and AR-markers for applications with untrained end-users. Robot. Auton. Syst. 66, 1–17 (2015)
Oliveira, G.L., Valada, A., Bollen, C., Burgard, W., Brox, T.: Deep learning for human part discovery in images. In: IEEE International Conference on Robotics and Automation (2016)
Pellegrini, S., Schindler, K., Nardi, D.: A generalisation of the ICP algorithm for articulated bodies. Proc. BMVC 3, 4 (2008)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings Third International Conference on 3-D Digital Imaging and Modeling, pp. 145–152. IEEE Computer Society (2001)
Salvi, J., Matabosch, C., Fofi, D., Forest, J.: A review of recent range image registration methods with accuracy evaluation. Image Vis. Comput. 25(5), 578 (2007)
Saval-Calvo, M., Azorin-Lopez, J., Fuster-Guillo, A., Garcia-Rodriguez, J., OrtsEscolano, S., Garcia-Garcia, A.: Evaluation of sampling method effects in 3D nonrigid registration. Neural Comput. Appl. 1–15 (2016)
Saval-Calvo, M., Azorin-Lopez, J., Fuster-Guillo, A., Mora-Mora, H.: \(\mu \)-mar: Multiplane 3D marker based registration for depth-sensing cameras. Expert Syst. Appl. 42(23), 9353–9365 (2015)
Schwarz, L.A., Mkhitaryan, A., Mateus, D., Navab, N.: Human skeleton tracking from depth data using geodesic distances and optical flow. Image Vis. Comput. 30(3), 217–226 (2012)
Shapiro, A., Feng, A., Wang, R., Li, H., Bolas, M., Medioni, G., Suma, E.: Rapid avatar capture and simulation using commodity depth sensors. Comput. Animation Virtual Worlds 25, 201–211 (2014)
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R.: Real-time human pose recognition in parts from single depth images. Commun. ACM 56(1), 116 (2013)
Tong, J., Zhou, J., Liu, L., Pan, Z., Yan, H.: Scanning 3D full human bodies using kinects. IEEE Trans. Vis. Comput. Graph. 18, 643–650 (2012)
Treleaven, P., Wells, J.: 3D body scanning and healthcare applications. Computer 40(7), 28–34 (2007)
Wang, R., Choi, J., Medioni, G.: Accurate full body scanning from a single fixed 3D camera. In: Proceedings - 2nd Joint 3DIM/3DPVT Conference: 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2012, pp. 432–439 (2012)
Wei, S.E., Ramakrishna, V., Kanade, T., Sheikh, Y.: Convolutional pose machines. In: Proceedings of CVPR, pp. 4724–4732 (2016)
Weiss, A., Hirshberg, D., Black, M.: Home 3D body scans from noisy image and range data. In: Computer Vision (ICCV), pp. 1951–1958 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Villena-Martinez, V., Fuster-Guillo, A., Saval-Calvo, M., Azorin-Lopez, J. (2017). 3D Body Registration from RGB-D Data with Unconstrained Movements and Single Sensor. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2017. Lecture Notes in Computer Science(), vol 10306. Springer, Cham. https://doi.org/10.1007/978-3-319-59147-6_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-59147-6_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59146-9
Online ISBN: 978-3-319-59147-6
eBook Packages: Computer ScienceComputer Science (R0)