Advertisement

Point Cloud Classification via the Views Generated from Coded Streaming Data

  • Qianqian Li
  • Long YeEmail author
  • Wei Zhong
  • Li Fang
  • Qin Zhang
Conference paper
  • 41 Downloads
Part of the Communications in Computer and Information Science book series (CCIS, volume 1181)

Abstract

Point cloud has been widely used in various fields such as virtual reality and autonomous driving. As the basis of point cloud processing, the research of point cloud classification draw many attentions. This paper proposes a views-based framework for streaming point cloud classification. We obtain six views from coded stream without fully decoding as the inputs of the neural network, and then a modified ResNet structure is proposed to generate the final classification results. The experimental results show that our framework achieve comparable result, while it could be used when the input is streaming point cloud data.

Keywords

Streaming Point cloud classification Views-based ResNet 

References

  1. 1.
    Wu, Z., et al.: 3D ShapeNets: a deep representation for volumetric shapes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1912–1920. (2015)Google Scholar
  2. 2.
    Maturana, D., Scherer, S.: VoxNet: a 3D convolutional neural network for real-time object recognition. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 922–928 (2015)Google Scholar
  3. 3.
    Qi, C.R., Su, H., Niener, M., Dai, A., Yan, M., Guibas, L.J.: Volumetric and multi-view CNNs for object classification on 3D data. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, pp. 5648–5656 (2016)Google Scholar
  4. 4.
    Charles, R.Q., Su, H., Mo, K., Guibas, L.: PointNet: deep learning on point sets for 3D classification and segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, pp. 77–85 (2017)Google Scholar
  5. 5.
    Charles, R.Q., Yi, L., Su, H., Guibas, L.: PointNet++: deep hierarchical feature learning on point sets in a metric space (2017)Google Scholar
  6. 6.
    Shen, Y., Feng, C., Yang, Y., Tian, D.: Mining point cloud local structures by kernel correlation and graph pooling. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, pp. 4548–4557 (2018)Google Scholar
  7. 7.
    Roveri, R., Rahmann, L., Öztireli, A.C., Gross, M.: A network architecture for point cloud classification via automatic depth images generation. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, pp. 4176–4184 (2018)Google Scholar
  8. 8.
    Feng, Y., Zhang, Z., Zhao, X., Ji, R., Gao, Y.: GVCNN: group-view convolutional neural networks for 3D shape recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, pp. 264–272 (2018)Google Scholar
  9. 9.
    Yu, T., Meng, J., Yuan, J.: Multi-view harmonized bilinear network for 3D object recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, pp. 186–194 (2018)Google Scholar
  10. 10.
    Kanezaki, A., Matsushita, Y., Nishida, Y.: RotationNet-joint object categorization and pose estimation using multiviews from unsupervised viewpoints. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, pp. 5010–5019 (2018)Google Scholar
  11. 11.
    Zhang, Z., Lin, H., Zhao, X., Ji, R., Gao, Y.: Inductive multi-hypergraph learning and its application on view-based 3D object classification. IEEE Trans. Image Process. 27(12), 5957–5968 (2018)MathSciNetCrossRefGoogle Scholar
  12. 12.
    He, L., Zhu, W., Xu, Y.: Best-effort projection based attribute compression for 3D point cloud. In: 23rd Asia-Pacific Conference on Communications (APCC), pp. 1–6 (2017)Google Scholar
  13. 13.
    Schwarz, S., et al.: Emerging MPEG standards for point cloud compression. IEEE J. Emerg. Sel. Top. Circuits Syst. 9, 133–148 (2019)CrossRefGoogle Scholar
  14. 14.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Qianqian Li
    • 1
  • Long Ye
    • 1
    Email author
  • Wei Zhong
    • 1
  • Li Fang
    • 1
  • Qin Zhang
    • 1
  1. 1.Key Laboratory of media Audio and VideoCommunication University of China, Ministry of EducationBeijingChina

Personalised recommendations