A Mixed-Reality Environment for Personalised and Collaborative Learning in Science and Engineering

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 716)


Mixed reality environments as in-betweens of real-world and virtual-reality (VR) environments are created by combining real world objects with computer generated ones. In general, mixed-reality along with VR technology provides innovative ways of showing relationships and connections in the real world, mainly by complimenting real objects with additional information (text, audio and video overlays). In Science Technology and Engineering (STE) disciplines, collaborative learning is about learners working together in teams or groups on structured learning tasks, that typically have a clearly defined goal and are arranged in such a manner that all members of the team are involved. A collaborative approach builds individual and group accountability in each learner as well as one or more soft skills such as communicating with peers, managing resources and the ability to make decisions. This paper presents the use of mixed-reality environments for personalised learning along with two approaches based on message passing paradigms for implementing collaborative learning in mixed-reality environments. The first approach shows the use of a pair of geographically distant mixed-reality environments for remote collaborative learning, while the second approach show multiple (independent) mixed-reality tools synchronised for co-located group work/learning. The statistical analysis of a research study with over 70 respondents from STE disciplines who were exposed to mixed-reality tools developed using mobile technology is also presented and discussed in the context of collaborative work within mixed-reality environments. The contributions includes unique implementations of mixed-reality based collaborative learning environments capable of providing similar experience to that obtained from traditional real-world environments.


Mixed-reality Collaborative-learning 


  1. 1.
    Albrechta, U., Nolla, C., von Jan, U.: Explore and experience: mobile augmented reality for medical training. In: Lehmann, C.U., Ammenwert, C., Nahr, C. (eds.) MEDINFO 2013: Studies in Health Technologis and Informatics, vol. 192, pp. 382–386. IMIE & IOS Press, Copehegen (2013)Google Scholar
  2. 2.
    Andujar, J.M., Mejias, A., Marquez, M.A.: Augmented reality for the improvement of remote laboratories: an augmented remote laboratory. IEEE Trans. Educ. 54(3), 492–500 (2011)CrossRefGoogle Scholar
  3. 3.
    Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacInTyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)CrossRefGoogle Scholar
  4. 4.
    Azuma, R.T.: A survey of augmented reality. Presence-Teleoperators Virtual Environ. 6(4), 355–385 (1997)CrossRefGoogle Scholar
  5. 5.
    Billinghurst, M., Kato, H., Poupyrev, I.: The MagicBook - moving seamlessly between reality and virtuality. IEEE Comput. Graph. Appl. 21(3), 6–8 (2001)Google Scholar
  6. 6.
    Broman, D., Sandahl, K., Baker, M.A.: The company approach to software engineering project courses. IEEE Trans. Educ. 55(4), 445–452 (2012)CrossRefGoogle Scholar
  7. 7.
    Canessa, E., Zennaro, M.: A mobile science index for development. Int. J. Interact. Mob. Technol. 6(1), 4–6 (2012)CrossRefGoogle Scholar
  8. 8.
    Climent-Bellido, M.S., Martnez-Jimnez, P., Pontes-Pedrajas, A., Polo, J.: Learning in chemistry with virtual laboratories. J. Chem. Educ. 80(3), 346 (2003)CrossRefGoogle Scholar
  9. 9.
    Davidsson, M., Johansson, D., Lindwall, K.: Exploring the use of augmented reality to support science education in secondary schools. In: Seventh International Conference on Wireless, Mobile and Ubiquitous Technology in Education, pp. 218–220. IEEE Computer Society (2012)Google Scholar
  10. 10.
    Davis, C.E., Yeary, M.B., Sluss, J.J.: Reversing the trend of engineering enrollment declines with innovative outreach, recruiting and retention programs. IEEE Trans. Educ. 55(2), 157–163 (2012)CrossRefGoogle Scholar
  11. 11.
    de Jong, T., Linn, M.C., Zacharia, Z.C.: Physical and virtual laboratories in science and engineering education. Science 340(6130), 305–308 (2013)CrossRefGoogle Scholar
  12. 12.
    Felder, R.M., Woods, D.R., Stice, J.E., Rugarcia, A.: The future of engineering education II. Teaching methods that work. Chem. Eng. Educ. 34(1), 26–39 (2000)Google Scholar
  13. 13.
    FitzGerald, E., Adams, A., Ferguson, R., Gaved, M., Mor, Y., Thomas, R.: Augmented reality and mobile learning: the state of the art. In: Specht, M., Sharples, M., Multisilta, J. (eds.) 11th World Conference on Mobile and Contextual Learning (mLearn 2012), pp. 62–69. CEUR, Helsinki (2012)Google Scholar
  14. 14.
    Gardner, M., Elliott, J.: The immersive education laboratory: understanding affordances, structuring experiences, and creating constructivist, collaborative processes, in mixed-reality smart environments. EAI Endorsed Trans. Future Intell. Educ. Environ. 14(1), e6 (2014)Google Scholar
  15. 15.
    Henderson, S.J., Feiner, S.: Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In: Proceedings of IEEE ISMAR-AMH, pp. 135–144. IEEE (2009)Google Scholar
  16. 16.
    Hosseinzadeh, N., Hesamzadeh, M.R.: Application of project-based learning (PBL) to the teaching of electrical powersystems engineering. IEEE Trans. Educ. 55(4), 495–501 (2012)CrossRefGoogle Scholar
  17. 17.
    Huppert, J., Lomask, S.M., Lazarowitz, R.: Computer simulations in the high school: students’ cognitive stages, science process skills and academic achievement in microbiology. Int. J. Sci. Educ. 24(8), 803–821 (2002)CrossRefGoogle Scholar
  18. 18.
    Jaakkola, T., Nurmi, S., Veermans, K.: A comparison of students’ conceptual understanding of electric circuits in simulation only and simulation-laboratory contexts. J. Res. Sci. Teach. 48(1), 71–93 (2011)CrossRefGoogle Scholar
  19. 19.
    Johnson, L., Adams Becker, S., Cummins, M., Estrada, V., Freeman, A., Hall, C.: Horizon report 2016: Higher education edition (2016). Accessed 9 Jul 2017
  20. 20.
    Kilby, J., Gray, K., Elliott, K., Waycott, J., Sanchez, F.M., Dave, B.: Designing a mobile augmented reality tool for the locative visualization of biomedical knowledge. In: Lehmann, C., Ammenwert, C., Nahr, C. (eds.) MEDINFO 2013: Studies in Health Technologis and Informatics, vol. 192, pp. 652–656. IMIE & IOS Press, Copenhagen (2013)Google Scholar
  21. 21.
    Kollffel, B., de Jong, T.: Conceptual understanding of electrical circuits in secondary vocational engineering education: combining traditional instruction with inquiry learning in a virtual lab. J. Eng. Educ. 102(3), 375–393 (2013)CrossRefGoogle Scholar
  22. 22.
    Liarokapis, F., Mourkoussis, N., White, M., Darcy, J., Sifniotis, M., Petridis, P., Basu, A., Lister, P.F.: Web3D and augmented reality to support engineering education. World Trans. Eng. Technol. Educ. 3(1), 11–14 (2004)Google Scholar
  23. 23.
    Loscos, C., Widenfeld, H.R., Roussou, M., Meyer, A., Tecchia, F., Drettakis, G., Gallo, E., Martinez, A.R., Tsingos, N., Chrysanthou, Y., Robert, L., Bergamasco, M., Dettori, A., Soubra, S.: The create project: mixed reality for design, education, and cultural heritage with a constructivist approach. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 282–283. IEEE (2003)Google Scholar
  24. 24.
    Macias, J.A.: Enhancing project-based learning in software engineering lab teaching through an e-portfolio approach. IEEE Trans. Educ. 55(4), 502–507 (2012)CrossRefGoogle Scholar
  25. 25.
    Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. Telemanipulator Telepresence Technol. 2351, 282–292 (1994). SPIECrossRefGoogle Scholar
  26. 26.
    Olympiou, G., Zacharia, Z.C.: Blending physical and virtual manipulatives in physics laboratory experimentation. In: Topics and Trends in Current Science Education, January 2014Google Scholar
  27. 27.
    Onime, C., Uhomoibhi, J.: Engineering education in a developing country: experiences from Africa. In: 2012 15th International Conference on Interactive Collaborative Learning (ICL), Villach, Austria, pp. 1–3 (2012)Google Scholar
  28. 28.
    Onime, C., Uhomoibhi, J., Pietrosemoli, E.: An augmented virtuality based solar energy power calculator in electrical engineering. Int. J. Eng. Pedagogy 5(1), 4–7 (2015)CrossRefGoogle Scholar
  29. 29.
    Onime, C., Uhomoibhi, J., Radicella, S.: MARE: mobile augmented reality based experiments in science, technology and engineering. In: Restivo, M.T.R., Cardoso, A., Lopez, A.M. (eds.) Online Experimentation: Emerging Technologies and IoT, pp. 209–227. IFSA Publishing, Barcelona (2015)Google Scholar
  30. 30.
    Onime, C., Uhomoibhi, J., Wang, H.: Mixed reality cubicles and cave automatic virtual environment. In: The 15th International Conference on Ubiquitous Computing and Communications (IUCC 2016), Grenada, Spain, pp. 1–8. IEEE Conference Publishing Services, December 2016Google Scholar
  31. 31.
    Onime, C., Uhomoibhi, J., Zennaro, M.: A low cost implementation of an existing hands-on laboratory experiment in electronic engineering. Int. J. Eng. Pedagogy 4(4), 1–3 (2014)Google Scholar
  32. 32.
    Pastoor, S., Conomis, C.: Mixed Reality Displays. Wiley, New York (2006). pp. 261–280Google Scholar
  33. 33.
    Schwald, B., de Laval, B.: An augmented reality system for training and assistance to maintenance in the industrial context. In: Proceedings of International Conference on Computer Graphics, Visualization, Computer Vision, pp. 425–432. IEEE Computer Society (2003)Google Scholar
  34. 34.
    Takemata, K., Nakamura, S., Minamide, A.: Design of a lifelong learning program with regional collaboration: intership for high school students. In: Aung, W., Ilic, V., Moscinski, J., Uhomoibhi, J. (eds.) Innovations 2011: World Innovations in Engineering Education and Research, pp. 3–11. iNEER, Potomac (2011)Google Scholar
  35. 35.
    Zacharia, Z.C., Olympiou, G., Papaevripidou, M.: Effects of experimenting with physical and virtual manipulatives on students’ conceptual understanding in heat and temperature. J. Res. Sci. Teach. 45(9), 1021–1035 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.International Centre for Theoretical PhysicsTriesteItaly
  2. 2.Ulster UniversityBelfastNorthern Ireland
  3. 3.African University of Science and TechnologyAbujaNigeria

Personalised recommendations