Pedestrian Height Estimation and 3D Reconstruction Using Pixel-resolution Mapping Method Without Special Patterns
Extracting the three-dimensional (3D) information including location and height of a pedestrian is important for vision-based intelligent traffic monitoring systems. This paper tackles the relationship between pixels′ actual size and pixels′ spatial resolution through a new method named pixel-resolution mapping (P-RM). The proposed P-RM method derives the equations for pixels′ spatial resolutions (XY-direction) and object′s height (Z-direction) in the real world, while introducing new tilt angle and mounting height calibration methods that do not require special calibration patterns placed in the real world. Both controlled laboratory and actual world experiments were performed and reported. The tests on 3D mensuration using proposed P-RM method showed overall better than 98.7% accuracy in laboratory environments and better than 96% accuracy in real world pedestrian height estimations. The 3D reconstructed images for measured points were also determined with the proposed P-RM method which shows that the proposed method provides a general algorithm for 3D information extraction.
KeywordsTraffic monitoring application spatial resolution pixel-resolution mapping (P-RM) method 3D information pedestrian height estimation
Unable to display preview. Download preview PDF.
- C. C. C. Pang, S. S. Xie, S. C. Wong, K. Choi. Generalized camera calibration model for trapezoidal patterns on the road. Optical Engineering, vol. 52, no. 1, Article number 017006, 2013. DOI: 10.1117/1.OE.52.1.017006.Google Scholar
- J. C. Liu, R. T. Collins, Y. X. Liu. Surveillance camera autocalibration based on pedestrian height distributions. In Proceedings of the British Machine Vision Conference, Dundee, UK, 2011.Google Scholar
- S. W. Park, T. E. Kim, J. S. Choi. Real-time estimation of trajectories and heights of pedestrians. In Proceedings of International Conference on Information Science and Applications, IEEE, Jeju Island, South Korea, 2011. DOI: 10.1109/ICISA.2011.5772407.Google Scholar
- J. Jung, H. Kim, I. Yoon, J. Paik. Human height analysis using multiple uncalibrated cameras. In Proceedings of IEEE International Conference on Consumer Electronics, IEEE, Las Vegas, USA, pp. 213–214, 2016. DOI: 10. 1109/ICCE.2016.7430585.Google Scholar
- J. Jung, I. Yoon, S. Lee, J. Paik. Object detection and tracking-based camera calibration for normalized human height estimation. Journal of Sensors, vol. 2016, Article number 8347841, 2016. DOI: 10.1155/2016/8347841.Google Scholar
- B. X. Wu, S. U. Ay, A. Abdel-Rahim. Trapezoid pixel array complementary metal oxide semiconductor image sensor with simplified mapping method for traffic monitoring applications. Optical Engineering, vol. 57, no. 9, Article number 093106, 2018. DOI: 10.1117/1.OE.57.9.093106.Google Scholar
- B. X. Wu, A. Abdel-Rahim, S. U. Ay. A trapezoid CMOS image sensor with 2% detection accuracy for traffic monitoring. In Proceedings of the 60th International Midwest Symposium on Circuits and Systems, IEEE, Boston, USA, pp. 1154–1158, 2017. DOI: 10.1109/MWSCAS.2017. 8053133.Google Scholar
- F. Rameau, A. Habed, C. Demonceaux, D. Sidibé, D. Fofi. Self-calibration of a PTZ camera using new LMI constraints. In Proceedings of the 11th Asian Conference on Computer Vision, Springer, Daejeon, Korea, pp. 297–308, 2012. DOI: 10.1007/978-3-642-37447-0_23.Google Scholar
- J. Nakamura. Image Sensors and Signal Processing for Digital Still Cameras, Boca Raton, USA: Taylor & Francis Group, 2006.Google Scholar
- L. A. Klein, M. K. Mills, D. R. P. Gibson. Traffic Detector Handbook, Volume II, 3rd ed, FHWA-HRT-06-139, USDOT, Washington, USA, 2006.Google Scholar