Augmented vision and interactive monitoring in 3D printing process

  • Alessandro Ceruti
  • Alfredo Liverani
  • Tiziano Bombardi
Original Paper


This paper describes the beneficial impact of an augmented reality based technique on the 3D printing process monitoring within additive manufacturing machines. A marker is applied in a fixed point of the rapid prototyping machine, integral with the component being manufactured; as an alternative, a markerless approach can be followed too. A virtual model of the object to be printed is superimposed to the real one. In this way, the shape of the object in different printing stages can be viewed. An interactive comparison between real and virtual model can be carried out both in manual and automatic mode. If manufacturing errors are detected, the building process can be stopped. Augmented reality technique allows an intuitive shape check of a part being printed with rapid prototyping technologies. In case of complex objects it helps the operator in the detection of possible errors along the manufacturing process; stopping the machine as soon as an error appears avoids waste of machining time and material. The average precision of the augmented reality is useful to find significant geometrical errors; geometrical deviations less than 1 mm can hardly be assessed both in manual and in automatic mode, and further studies should be carried out to increase the technique precision and range of application. To the best of the authors’ knowledge it is the first time where experiments on the integration between augmented reality and rapid prototyping to interactively monitor 3D parts’ printing have been investigated and reported in literature.


Rapid Prototyping Additive Manufacturing Augmented Reality 3D printing Design 


  1. 1.
    Sass, L., Oxman, R.: Materializing design: the implications of rapid prototyping in digital design. Design Stud. 27(3), 325–355 (2006)CrossRefGoogle Scholar
  2. 2.
    Pennington, B.C., Hoekstra, N.L., Newcomer, J.L.: Significant factors in the dimensional accuracy of fused deposition modelling. J. Process Mech. Eng. 219, 89–92 (2005)CrossRefGoogle Scholar
  3. 3.
    Kim, G.D., Oh, Y.T.: A benchmark study on rapid prototyping processes and machines: quantitative comparisons of mechanical properties, accuracy, roughness, speed, and material cost. Proc. ImechE Vol. 222 (2) Part B, J. Engineering Manufacture, pp. 201–215 (2008)Google Scholar
  4. 4.
    Roberson, D.A., Espalin, D., Wicker, R.B.: 3D printer selection: a decision-making evaluation and ranking model. Virtual Phys. Prototyp. 8(3), 201–212 (2013). doi: 10.1080/17452759.2013.830939 CrossRefGoogle Scholar
  5. 5.
    Ahn, S.H., Montero, M., Odell, D., Roundy, S., Wright, P.: Anisotropic material properties of fused deposition modeling ABS. Rapid Prototyp. J. 8(4), 248–257 (2002). doi: 10.1108/13552540210441166 CrossRefGoogle Scholar
  6. 6.
    Ghidini, T., Pambaguian, L., Blair, S.: Joining the third industrial revolution: 3D printing for space. Eur. Space Agency Bull. (2015)Google Scholar
  7. 7.
    Oxman, N.: Variable property rapid prototyping. Virtual Phys. Prototyp. J. 6(1), 3–31 (2011)CrossRefGoogle Scholar
  8. 8.
    Aghanajafi, C., Daneshmand, S., Nadooshan, A.A.: Influence of layer thickness on the design of rapid-prototyped models. J. Aircr. 46(3), 981–987 (2009)CrossRefGoogle Scholar
  9. 9.
    Dhakshyani, R., Nukman, Y., Abu Osman, N.A.: FDM models and FEA in dysplastic hip. Rapid Prototyp. J. 18(3), 215–221 (2012). doi: 10.1108/13552541211218144 CrossRefGoogle Scholar
  10. 10.
    Zhang, Y., Chou, K.: A parametric study of part distortions in fused deposition modelling using three-dimensional finite element analysis. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 222, 959–968 (2008)CrossRefGoogle Scholar
  11. 11.
    Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 355–385 (1997)Google Scholar
  12. 12.
    Nee, A.Y.C., Ong, S.K., Chryssolourius, G., Mourtzis, D.: Augmented reality applications in design and manufacturing. CIRP Ann. Manuf. Technol. 61, 657–679 (2012)CrossRefGoogle Scholar
  13. 13.
    Liverani, A., Leali, F., Pellicciari, M.: Real-time 3D features reconstruction through monocular vision. Int. J. Interact. Des. Manuf. (IJIDeM) 4(2), 103–112 (2010)CrossRefGoogle Scholar
  14. 14.
    De Marchi, L., Ceruti, A., Marzani, A., Liverani, A.: Augmented reality to support on-field post-impact maintenance operations on thin structures. J. Sens. 619570, 1–10 (2013)Google Scholar
  15. 15.
    Debernardis, S., Fiorentino, M., Gattullo, M., Monno, G., Uva, A.E.: Text readability in head-worn displays: Color and style optimization in video vs. optical see-through devices. IEEE Trans. Vis. Comput. Graph. 20(1), 125–139 (2013)CrossRefGoogle Scholar
  16. 16.
    AR toolkit library documentation. Available on line at: Retrieved on July 10, (2016)
  17. 17.
    Bay, H., Tuytelaars, T., Van Gool, L.: Surf: speeded up robust features. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 3951 LNCS, pp. 404–417Google Scholar
  18. 18.
    Lowe, D.G.: Object recognition from local scale-invariant features. Proc. Int. Conf. Comput. Vis. 2, 1150–1157 (1999)Google Scholar
  19. 19.
    Open CV libraries documentation. Available on line at: Retrieved on July 10, (2016)
  20. 20.
    The Mathworks corporation, Image Processing toolbox for \(\text{Matlab}^{\textregistered }\). Available on line at: Retrieved on July 10, (2016)
  21. 21.
    Dung, L., Huang, C., Wu, Y.: Implementation of RANSAC algorithm for feature-based image registration. J. Comput. Commun. 1, 46–50 (2013). doi: 10.4236/jcc.2013.16009 CrossRefGoogle Scholar
  22. 22.
    Liverani, A., Ceruti, A., Caligiana, G.: Tablet-based 3D sketching and curve reverse modelling. Int. J. Comput. Aided Eng. Technol. (IJCAET), Vol. 5, No. 2/3, (2013)Google Scholar
  23. 23.
    Liverani, A., Ceruti, A.: Interactive GT code management for mechanical part similarity search and cost prediction. Comput. Aided Des. Appl. 7, 1–15 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag France 2016

Authors and Affiliations

  1. 1.DIN DepartmentUniversity of BolognaBolognaItaly

Personalised recommendations