Recognizing and Classifying Unknown Object in BIM Using 2D CNN

  • Jinsung Kim
  • Jaeyeol Song
  • Jin-Kook LeeEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1028)


This paper aims to propose an approach to automated classifying building element instance in BIM using deep learning-based 3D object classification algorithm. Recently, studies related to checking or validating engine of BIM object for ensuring data integrity of BIM instances are getting attention. As a part of this research, this paper train recognition models that are targeted at basic building element and interior element using 3D object recognition technique that uses images of objects as inputs. Object recognition is executed in two stages; (1) class of object (e.g. wall, window, seating furniture, toilet fixture and etc.), (2) sub-type of specific classes (e.g. Toilet or Urinal). Using the trained models, BIM plug-in prototype is developed and the performance of this AI-based approach with test BIM model is checked. We expect this recognition approach to help ensure the integrity of BIM data and contribute to the practical use of BIM.


3D object classification Building element Building information modeling Data integrity Interior element 



This research was supported by a grant (19AUDP-B127891-03) from the Architecture & Urban Development Research Program funded by the Ministry of Land, Infrastructure and Transport of the Korean government.


  1. 1.
    Eastman, C., et al.: Automatic rule-based checking of building designs. Autom. Constr. 18(8), 1011–1033 (2009)CrossRefGoogle Scholar
  2. 2.
    Lee, Y.-C., et al.: Validations for ensuring the interoperability of data exchange of a building information model. Autom. Constr. 58, 176–195 (2015)CrossRefGoogle Scholar
  3. 3.
    Koo, B., Shin, B.: Applying novelty detection to identify model element to IFC class misclassifications on architectural and infrastructure building information models. J. Comput. Design Eng. 5(4), 391–400 (2018)CrossRefGoogle Scholar
  4. 4.
    IFC Solutions Factory: Model View Definitions Site. Accessed 29 Mar 2019
  5. 5.
    Weise, M., et al.: Integrating use case definitions for IFC developments, eWork and eBusiness in architecture and construction, pp. 637–645 (2009)Google Scholar
  6. 6.
    SMC: Solibri Model Checker. Accessed 29 Mar 2019
  7. 7.
    Sacks, R., et al.: Semantic enrichment for building information modeling: procedure for compiling inference rules and operators for complex geometry. J. Comput. Civ. Eng. 31(6), 256–272 (2017)CrossRefGoogle Scholar
  8. 8.
    Bloch, T., Sacks, R.: Comparing machine learning and rule-based inferencing for semantic enrichment of BIM models. Autom. Constr. 91, 256–272 (2018)CrossRefGoogle Scholar
  9. 9.
    Koo, B., et al.: Using support vector machines to classify building elements for checking the semantic integrity of building information models. Autom. Constr. 98, 183–194 (2019)CrossRefGoogle Scholar
  10. 10.
    The Princeton ModelNet. Accessed 29 Mar 2019
  11. 11.
    Maturana, D., Scherer, S.: VoxNet: a 3D convolutional neural network for real-time object recognition. In: 2015 IEEE/RSJ International Conference Proceedings of Intelligent Robots and Systems (IROS), pp. 922–928 (2015)Google Scholar
  12. 12.
    Su, H., et al.: Multi-view convolutional neural networks for 3D shape recognition. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 945–953 (2015)Google Scholar
  13. 13.
    Krizhevsky A., et al.: ImageNet classification with deep convolutional neural networks. In: Proceedings of Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  14. 14.
    Wu, Z., et al.: 3D ShapeNets: a deep representation for volumetric shapes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1912–1920 (2015)Google Scholar
  15. 15.
    Szegedy, C., et al.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)Google Scholar
  16. 16.
    Deng, J., et al.: Imagenet: a large-scale hierarchical image database. In: Proceedings of Computer Vision and Pattern Recognition, pp. 248–255 (2009)Google Scholar
  17. 17.
    Abadi, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems, arXiv preprint arXiv:1603.04467 (2016)
  18. 18.
    KBIMS Library. Accessed 29 Mar 2019
  19. 19.
    BIMObject: BIM Libarary. Accessed 29 Mar 2019
  20. 20.
    3Dwarehouse. Accessed 29 Mar 2019
  21. 21.
    Revit and Revit API. Accessed 29 Mar 2019
  22. 22.
    Omniclass: a classification system for the construction industry. http://www.omniclass.orgAccessed 29 Mar 2019

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Department of Interior Architecture and Built EnvironmentYonsei UniversitySeoulRepublic of Korea

Personalised recommendations