Abstract
As human beings, from an early age, learning and discovery are enabled by senses: visually exploring the 3D world around, holding and touching objects or listening to others and asking questions. In a traditional education environment, training setup or collaborative work, the majority of the interaction modalities and written materials are still designed for a 2D visual space (e.g., books, course web pages, articles, videos, and images). With the rapid advances in technology, new interaction modalities become widely available and have the potential to improve, and often revolutionize the way we interact, learn and cooperate with each other. The chapter explores new interaction paradigms and systems enabling the shift from a 2D visual space to 3D user interfaces, as well as the addition of a new interaction modality, the tactile or touch modality, through haptic user interfaces. The International Standards Organization’s extended 3D (X3D) open standard provides a considerable opportunity to design and implement innovative and revolutionary Web-based interfaces to support and augment engineering courses and design activities. Haptics devices and associated APIs are enabling a revolution in engineering interaction design and engineering education. Several use-cases and example Web3D applications are presented to provide an overview of the existing trends. A concise presentation of the human tactile system, followed by a survey on current haptics hardware accompanied by several successful implementations for engineering education, highlights the near future trends.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
3DSystems (2018) “The Touch haptic device” former Phantom Omni. https://www.3dsystems.com/haptics-devices/touch. Accessed 6 Sept 2018
Afifi K, Bergman RA (2005) Functional neuroanatomy: text and Atlas, 2nd edn. McGraw Hill Professional, 18 Feb 2005
Akahane K, Hyun J, Kumazawa I, Sato M (2013) Two-handed multi-finger string-based haptic interface SPIDAR-8. In: Galiana I, Ferre M (eds) Multi-finger haptic interaction. Springer series on touch and haptic systems. Springer, London
Allied A (2018) Global 3D display market (Type, Technologies, Access Methods, Application, and Geography)—size, share, global trends, company profiles, demand, insights, analysis, research, report, opportunities, segmentation and forecast, 2013–2020, Oct 2018
Alting A, Walser A (2007) Retention and persistence of undergraduate engineering students: what happens after the first year? In: Proceedings of the American society for engineering education annual conference and exposition, Honolulu, HI. https://peer.asee.org/2344
Annetta LA, Folta E, Klesath M (2010) V-learning: distance education in the 21st century through 3D virtual learning environments, Springer. ISBN 9048136202
BitManagement (2017) Automatic construction of 3D cities. http://www.web3d.org/case-studies/automatic-construction-3d-cities/automatic-construction-3d-cities. Accessed 15 Sept 2018
BitManagement (2018) City of Vienna. http://www.web3d.org/example/historic-vienna. Accessed 15 Sept 2018
Blend (2018) Blend for web—unleashing the power of 3D internet. https://www.blend4web.com/en/. Accessed 15 Sept 2018
Bramlet M (2018) Pulmonary atresia, VSD with confluent branch pulmonary arteries and PDA. https://3dprint.nih.gov/discover/3dpx-001608. Accessed 15 Sept 2018
Brutzman D, Daly L (2007) X3D: 3D graphics for web authors, Morgan Kaufmann Publishers
Brus C, Zhao L, Jessop J (2004) Visual-spatial ability in first-year engineering students: a useful retention variable? In: Proceedings of the American society for engineering education annual conference and exposition, Portland, OR
Bourke P (2012) Automatic 3D reconstruction: an exploration of the state of the art. GSTF J Comput (JoC) 2(3)
Casakin H, Badke-Schaub P (2015) Mental models and creativity in engineering and architectural design teams. In: Gero J, Hanna S (eds) Design computing and cognition ’14. Springer, Cham
CHAI3D (2018) Computer haptics and active interfaces—CHAI3D. https://www.chai3d.org. Accessed 10 Oct 2018
Colomina I, Molina P (2014) Unmanned aerial systems for photogrammetry and remote sensing: a review. ISPRS J Photogramm Remote Sens 92:79–97
Cutler LD, Frohlich B, Hanrahan P (1997) Two-handed direct manipulation on the responsive workbench. In: Proceedings of ACM symposium on interactive 3D graphics, pp 107–114
Dimension F (2018) Force dimensions haptic devices. http://www.forcedimension.com/. Accessed 3 Oct 2018
Duffy G (2017) Spatial thinking in the engineering curriculum: an investigation of the relationship between problem solving and spatial skills among engineering students. Doctoral thesis, DIT
Eisenbeiss H (2009) UAV photogrammetry. PhD Thesis, Swiss Federal Institute of Technology Zurich, Zurich, Switzerland
Fazio C, Battaglia OR, Paola B (2013) Investigating the quality of mental models deployed by undergraduate engineering students in creating explanations: the case of thermally activated phenomena. Phys Rev ST Phys Educ Res 9(2), American Physical Society
Fraunhofer (2018) CAD viewer. http://www.web3d.org/example/cad-scene-graph-viewer. Accessed 10 Sept 2018
Goeser PT, Johnson WM, Hamza-Lup FG, Schaefer D (2011) VIEW—a virtual interactive web-based learning environment for engineering. IEEE Adv Eng Educ J Spec Issue Res e-Learn Eng Educ 2(3). ISSN: 1941-1766.
Goeser PT, Johnson WM, Hamza-Lup FG, Sopin I, Sanchez C, Hager P (2009) A different view: virtual interactive engineering on the web. In: Proceedings of the American society for engineering education annual conference and exposition, June 14–17, Austin, Texas
Guiard Y (1987) Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. J Motor Behav 19(4):486–517
Halloun A, Hestenes D (1985) The initial knowledge state of college physics students. Am J Phys 53:1043–1055
Hamza-Lup FG, Adams M (2008) Feel the pressure: e-learning system with haptic feedback. In: The 16th symposium on haptic interfaces for virtual environments and teleoperator systems (Haptics 2008), March 13–14. Reno, Nevada, pp 445–450
Hamza-Lup FG, Baird WH (2012) Feel the static and kinetic friction. EuroHaptics 2012, Part I, LNCS 7282, 12–15 June. Tampere, Finland, pp 181–192
Hamza-Lup FG, Goldbach IR (2019) Survey on intelligent dialogue in e-learning systems. In: Proceedings of the international conference on mobile, hybrid, and on-line learning, Feb 24–28. Athens, Greece, pp 49–52. ISBN: 8-1-61208-689-7
Hamza-Lup FG, Maghiar M (2016) Web3D graphics enabled through sensor networks for cost-effective assessment and management of energy efficiency in buildings. Graph Models J Elsevier 88:66–74. www.sciencedirect.com/science/article/pii/S1524070316300042
Hamza-Lup FG, Goeser PT, Johnson WM, Thompson T, Railean E, Popovici DM, Hamza-Lup G (2009) Interactive 3D web-based environments for online learning: case studies, technologies and challenges. In: International conference on mobile, hybrid, and online learning, Feb 1–7. Cancun, Mexico, pp 13–18
Hamza-Lup FG, Bergeron K, Newton D (2019) haptic systems in user interfaces—state of the art survey. In: Proceedings of ACMSE 2019, 18–20 April 2019. Kennesaw, GA, USA
Hinckley K, Pausch R, Proffitt D, Patten J, Kassell N (1997) Cooperative bimanual action. In: Proceedings of ACM SIGCHI conference on human factors in computing systems, 1997, pp 27–34
Hullo JF, Thibault G, Boucheny C, Dory F, Mas A (2015) Multi-sensor as-built models of complex industrial architectures. Remote Sens 7:16339–16362
H3D (2018) Haptics 3D by Sense graphics “H3D application programming interface manual”. http://www.h3dapi.org. Accessed 2 Oct 2018
Johnson KO (2001) The roles and functions of cutaneous mechanoreceptors. Current Opin Neurobiol 11(4):455–61. Review. PubMed PMID: 11502392
Jones BD, Setareh M, Polys NF, Bacim F (2014) Application of an online interactive simulation tool to teach engineering concepts using 3D spatial structures. Int J Web-Based Learn Teach Technol (IJWLTT) 9(3)
Kocadag F-AL, Hamza-Lup FG (2013) X3D in Urban Planning – Savannah in 3D. In: The Proceedings of the 51st association for computing machinery southeast conference, April 4–6, Savannah, Georgia, US. ISBN: 978–1–4503–1901–0
Lansard M (2018) The 8 best 3D scanning apps for smartphones and iPads. https://www.aniwaa.com/best-3d-scanning-apps-smartphones/. Accessed 18 Oct 2108
Lopes D, Vaz de Carvalho C (2010) Simulation and haptic devices in engineering education. Elektronika ir Elektrotechnika 102(6). http://eejournal.ktu.lt/index.php/elt/article/view/9383. Accessed 17 Oct 2018
Maglev M (2018) Maglev 200™ system—high-fidelity interaction with virtual or remote environments. http://butterflyhaptics.com/products/system/. Accessed 2 Oct 2018
Massy-Westropp NM, Gill TK, Taylor AW, Bohannon RW, Hill CW (2011) Hand grip strength: age and gender stratified normative data in a population-based study. BMC Res Notes 4:127. https://doi.org/10.1186/1756-0500-4-127
McGlone F, Reilly D (2010) The cutaneous sensory system. Neurosci Biobehav Rev 34(2010):148–159
Neri L, Noguez J, Robledo-Rella V, Escobar-Castillejos D, Gonzalez-Nucamendi A (2018) Teaching of classical mechanics concepts using visuo-haptic simulators. Educ Technol Soc 21(2):85–97
OpenHaptics (2018) OpenHaptic by 3DSystems “OpenHaptics developer edition”. https://www.3dsystems.com/haptics-devices/openhaptics. Accessed 10 Oct 2018
Polys NF, Bacim F, Setareh M, Jones B (2013) Building novel Web3D user interfaces: a case study from architecture and structural engineering. In: Proceedings of the 18th international conference on 3D web technology (Web3D ’13). ACM, San Sebastian ES, pp 135–138
Polys NF, Bacim F, Setareh M, Jones B (2015) SAFAS: unifying form and structure through interactive 3D simulation. Eng Design Graph J 79:1–23
Polys NF, Newcomb C, Schenk T, Skuzinski T, Dunay D (2018) The value of 3D models and immersive technology in planning urban density. In: Proceedings of the 23rd international ACM conference on 3D web technology (Web3D ’18). ACM, New York, NY, USA, Article 13, 4 pp. https://doi.org/10.1145/3208806.3208824
Popovici DM, Hamza-Lup FG, Seitan A, Bogdan CM (2012) Comparative study of APIs and frameworks for haptic application development. In: 12th international conference on cyberworlds, Darmstadt, Germania, 25–27 Sept 2012, pp 37–44
Proske U, Gandevia SC (2012) The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. Physiol Rev 92(4):1651–1697
Rosen A (2009) e-Learning 2.0: proven practices and emerging technologies to achieve real results, AMACOM, 2009. ISBN 0814410731
Sense S (2018) Take your world from physical to digital with 3D scanning. https://www.3dsystems.com/3d-scanners/sense-scanner. Accessed 2 Sept 2018
Setareh M, Jones B, Ma L, Bacim F, Polys N (2015) Application and evaluation of double-layer grid spatial structures for the engineering education of architects. J Architect Eng 21(3)
Smith A, Knizley A, Luck R (2017) A product dissection project designed for student motivation and retention in an introduction to engineering course. American Society for Engineering Education, San Juan, Puerto Rico, 2–5 Mar 2017
SOFA (2018) Simulation open framework architecture—SOFA. http://www.sofa-framework.org. Accessed 2 Oct 2018
Steenkamp H, Nel AL, Carroll J (2017) Retention of engineering students. In: 2017 IEEE global engineering education conference (EDUCON), Athens, 2017, pp 693–698. https://doi.org/10.1109/educon.2017.7942922.
Titania (2018) Titania X3D editor—bring colours to your life. http://create3000.de/users-guide/. Accessed 5 Oct 2018
Takasaki M, Nara T, Tachi S, Higuchi T (2000) A tactile display using surface acoustic wave. In: Proceedings 9th IEEE international workshop on robot and human interactive communication, Osaka, Japan, 2000, pp 364–367
Talvas A, Marchal M, Lecuyer A (2014) A survey on bimanual haptic interaction. IEEE Trans Haptics 7(3):285–300
Udin WS, Ahmad A (2012) Large scale mapping using digital aerial imagery of unmanned aerial vehicle. Int J Sci Eng Res 3:1–6
Uttal DH, Cohen CA (2012) Spatial thinking and STEM education. In: The psychology of learning and motivation, vol 57, pp 147–181. ISSN: 0079–7421
Voss K, Musall E (2012) Net zero energy buildings—international projects of carbon neutrality in buildings, 2nd edn, Nov 2012. Institut für Internationale Architektur-Dokumentation GmbH & Co. KG, München. ISBN 978-3-920034-80-5
WebGL (2018) The Khronos project—WebGL. https://www.khronos.org/webgl/. Accessed 5 Oct 2018
Wright R, Thompson WL, Ganis G, Newcombe NS, Kosslyn SM (2008) Training generalized spatial skills. Psychon Bull Rev 15:763–771
X3DOM (2018) What is X3DOM, and what can it do for me? https://doc.x3dom.org/gettingStarted/background/index.html. Accessed 5 Oct 2018
Acknowledgements
We would like to acknowledge Don Butzman and Nicholas Polys for discussions about the X3D standard and novel interaction techniques in the 3D space. This work was also facilitate by the Erasmus+ program for international cooperation between Georgia Southern University, US and Transilvania University of Brasov, Romania.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Hamza-Lup, F.G. (2019). Designing Knowledge Sharing Interfaces with Improved Interaction: Haptics and Web3D. In: Schaefer, D., Coates, G., Eckert, C. (eds) Design Education Today. Springer, Cham. https://doi.org/10.1007/978-3-030-17134-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-17134-6_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-17133-9
Online ISBN: 978-3-030-17134-6
eBook Packages: EngineeringEngineering (R0)