Skip to main content

Designing Knowledge Sharing Interfaces with Improved Interaction: Haptics and Web3D

  • Chapter
  • First Online:
Design Education Today

Abstract

As human beings, from an early age, learning and discovery are enabled by senses: visually exploring the 3D world around, holding and touching objects or listening to others and asking questions. In a traditional education environment, training setup or collaborative work, the majority of the interaction modalities and written materials are still designed for a 2D visual space (e.g., books, course web pages, articles, videos, and images). With the rapid advances in technology, new interaction modalities become widely available and have the potential to improve, and often revolutionize the way we interact, learn and cooperate with each other. The chapter explores new interaction paradigms and systems enabling the shift from a 2D visual space to 3D user interfaces, as well as the addition of a new interaction modality, the tactile or touch modality, through haptic user interfaces. The International Standards Organization’s extended 3D (X3D) open standard provides a considerable opportunity to design and implement innovative and revolutionary Web-based interfaces to support and augment engineering courses and design activities. Haptics devices and associated APIs are enabling a revolution in engineering interaction design and engineering education. Several use-cases and example Web3D applications are presented to provide an overview of the existing trends. A concise presentation of the human tactile system, followed by a survey on current haptics hardware accompanied by several successful implementations for engineering education, highlights the near future trends.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • 3DSystems (2018) “The Touch haptic device” former Phantom Omni. https://www.3dsystems.com/haptics-devices/touch. Accessed 6 Sept 2018

  • Afifi K, Bergman RA (2005) Functional neuroanatomy: text and Atlas, 2nd edn. McGraw Hill Professional, 18 Feb 2005

    Google Scholar 

  • Akahane K, Hyun J, Kumazawa I, Sato M (2013) Two-handed multi-finger string-based haptic interface SPIDAR-8. In: Galiana I, Ferre M (eds) Multi-finger haptic interaction. Springer series on touch and haptic systems. Springer, London

    Google Scholar 

  • Allied A (2018) Global 3D display market (Type, Technologies, Access Methods, Application, and Geography)—size, share, global trends, company profiles, demand, insights, analysis, research, report, opportunities, segmentation and forecast, 2013–2020, Oct 2018

    Google Scholar 

  • Alting A, Walser A (2007) Retention and persistence of undergraduate engineering students: what happens after the first year? In: Proceedings of the American society for engineering education annual conference and exposition, Honolulu, HI. https://peer.asee.org/2344

  • Annetta LA, Folta E, Klesath M (2010) V-learning: distance education in the 21st century through 3D virtual learning environments, Springer. ISBN 9048136202

    Google Scholar 

  • BitManagement (2017) Automatic construction of 3D cities. http://www.web3d.org/case-studies/automatic-construction-3d-cities/automatic-construction-3d-cities. Accessed 15 Sept 2018

  • BitManagement (2018) City of Vienna. http://www.web3d.org/example/historic-vienna. Accessed 15 Sept 2018

  • Blend (2018) Blend for web—unleashing the power of 3D internet. https://www.blend4web.com/en/. Accessed 15 Sept 2018

  • Bramlet M (2018) Pulmonary atresia, VSD with confluent branch pulmonary arteries and PDA. https://3dprint.nih.gov/discover/3dpx-001608. Accessed 15 Sept 2018

  • Brutzman D, Daly L (2007) X3D: 3D graphics for web authors, Morgan Kaufmann Publishers

    Google Scholar 

  • Brus C, Zhao L, Jessop J (2004) Visual-spatial ability in first-year engineering students: a useful retention variable? In: Proceedings of the American society for engineering education annual conference and exposition, Portland, OR

    Google Scholar 

  • Bourke P (2012) Automatic 3D reconstruction: an exploration of the state of the art. GSTF J Comput (JoC) 2(3)

    Google Scholar 

  • Casakin H, Badke-Schaub P (2015) Mental models and creativity in engineering and architectural design teams. In: Gero J, Hanna S (eds) Design computing and cognition ’14. Springer, Cham

    Google Scholar 

  • CHAI3D (2018) Computer haptics and active interfaces—CHAI3D. https://www.chai3d.org. Accessed 10 Oct 2018

  • Colomina I, Molina P (2014) Unmanned aerial systems for photogrammetry and remote sensing: a review. ISPRS J Photogramm Remote Sens 92:79–97

    Article  Google Scholar 

  • Cutler LD, Frohlich B, Hanrahan P (1997) Two-handed direct manipulation on the responsive workbench. In: Proceedings of ACM symposium on interactive 3D graphics, pp 107–114

    Google Scholar 

  • Dimension F (2018) Force dimensions haptic devices. http://www.forcedimension.com/. Accessed 3 Oct 2018

  • Duffy G (2017) Spatial thinking in the engineering curriculum: an investigation of the relationship between problem solving and spatial skills among engineering students. Doctoral thesis, DIT

    Google Scholar 

  • Eisenbeiss H (2009) UAV photogrammetry. PhD Thesis, Swiss Federal Institute of Technology Zurich, Zurich, Switzerland

    Google Scholar 

  • Fazio C, Battaglia OR, Paola B (2013) Investigating the quality of mental models deployed by undergraduate engineering students in creating explanations: the case of thermally activated phenomena. Phys Rev ST Phys Educ Res 9(2), American Physical Society

    Google Scholar 

  • Fraunhofer (2018) CAD viewer. http://www.web3d.org/example/cad-scene-graph-viewer. Accessed 10 Sept 2018

  • Goeser PT, Johnson WM, Hamza-Lup FG, Schaefer D (2011) VIEW—a virtual interactive web-based learning environment for engineering. IEEE Adv Eng Educ J Spec Issue Res e-Learn Eng Educ 2(3). ISSN: 1941-1766.

    Google Scholar 

  • Goeser PT, Johnson WM, Hamza-Lup FG, Sopin I, Sanchez C, Hager P (2009) A different view: virtual interactive engineering on the web. In: Proceedings of the American society for engineering education annual conference and exposition, June 14–17, Austin, Texas

    Google Scholar 

  • Guiard Y (1987) Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. J Motor Behav 19(4):486–517

    Article  Google Scholar 

  • Halloun A, Hestenes D (1985) The initial knowledge state of college physics students. Am J Phys 53:1043–1055

    Article  Google Scholar 

  • Hamza-Lup FG, Adams M (2008) Feel the pressure: e-learning system with haptic feedback. In: The 16th symposium on haptic interfaces for virtual environments and teleoperator systems (Haptics 2008), March 13–14. Reno, Nevada, pp 445–450

    Google Scholar 

  • Hamza-Lup FG, Baird WH (2012) Feel the static and kinetic friction. EuroHaptics 2012, Part I, LNCS 7282, 12–15 June. Tampere, Finland, pp 181–192

    Chapter  Google Scholar 

  • Hamza-Lup FG, Goldbach IR (2019) Survey on intelligent dialogue in e-learning systems. In: Proceedings of the international conference on mobile, hybrid, and on-line learning, Feb 24–28. Athens, Greece, pp 49–52. ISBN: 8-1-61208-689-7

    Google Scholar 

  • Hamza-Lup FG, Maghiar M (2016) Web3D graphics enabled through sensor networks for cost-effective assessment and management of energy efficiency in buildings. Graph Models J Elsevier 88:66–74. www.sciencedirect.com/science/article/pii/S1524070316300042

    Article  MathSciNet  Google Scholar 

  • Hamza-Lup FG, Goeser PT, Johnson WM, Thompson T, Railean E, Popovici DM, Hamza-Lup G (2009) Interactive 3D web-based environments for online learning: case studies, technologies and challenges. In: International conference on mobile, hybrid, and online learning, Feb 1–7. Cancun, Mexico, pp 13–18

    Google Scholar 

  • Hamza-Lup FG, Bergeron K, Newton D (2019) haptic systems in user interfaces—state of the art survey. In: Proceedings of ACMSE 2019, 18–20 April 2019. Kennesaw, GA, USA

    Google Scholar 

  • Hinckley K, Pausch R, Proffitt D, Patten J, Kassell N (1997) Cooperative bimanual action. In: Proceedings of ACM SIGCHI conference on human factors in computing systems, 1997, pp 27–34

    Google Scholar 

  • Hullo JF, Thibault G, Boucheny C, Dory F, Mas A (2015) Multi-sensor as-built models of complex industrial architectures. Remote Sens 7:16339–16362

    Article  Google Scholar 

  • H3D (2018) Haptics 3D by Sense graphics “H3D application programming interface manual”. http://www.h3dapi.org. Accessed 2 Oct 2018

  • Johnson KO (2001) The roles and functions of cutaneous mechanoreceptors. Current Opin Neurobiol 11(4):455–61. Review. PubMed PMID: 11502392

    Article  Google Scholar 

  • Jones BD, Setareh M, Polys NF, Bacim F (2014) Application of an online interactive simulation tool to teach engineering concepts using 3D spatial structures. Int J Web-Based Learn Teach Technol (IJWLTT) 9(3)

    Google Scholar 

  • Kocadag F-AL, Hamza-Lup FG (2013) X3D in Urban Planning – Savannah in 3D. In: The Proceedings of the 51st association for computing machinery southeast conference, April 4–6, Savannah, Georgia, US. ISBN: 978–1–4503–1901–0

    Google Scholar 

  • Lansard M (2018) The 8 best 3D scanning apps for smartphones and iPads. https://www.aniwaa.com/best-3d-scanning-apps-smartphones/. Accessed 18 Oct 2108

  • Lopes D, Vaz de Carvalho C (2010) Simulation and haptic devices in engineering education. Elektronika ir Elektrotechnika 102(6). http://eejournal.ktu.lt/index.php/elt/article/view/9383. Accessed 17 Oct 2018

  • Maglev M (2018) Maglev 200™ system—high-fidelity interaction with virtual or remote environments. http://butterflyhaptics.com/products/system/. Accessed 2 Oct 2018

  • Massy-Westropp NM, Gill TK, Taylor AW, Bohannon RW, Hill CW (2011) Hand grip strength: age and gender stratified normative data in a population-based study. BMC Res Notes 4:127. https://doi.org/10.1186/1756-0500-4-127

    Article  Google Scholar 

  • McGlone F, Reilly D (2010) The cutaneous sensory system. Neurosci Biobehav Rev 34(2010):148–159

    Article  Google Scholar 

  • Neri L, Noguez J, Robledo-Rella V, Escobar-Castillejos D, Gonzalez-Nucamendi A (2018) Teaching of classical mechanics concepts using visuo-haptic simulators. Educ Technol Soc 21(2):85–97

    Google Scholar 

  • OpenHaptics (2018) OpenHaptic by 3DSystems “OpenHaptics developer edition”. https://www.3dsystems.com/haptics-devices/openhaptics. Accessed 10 Oct 2018

  • Polys NF, Bacim F, Setareh M, Jones B (2013) Building novel Web3D user interfaces: a case study from architecture and structural engineering. In: Proceedings of the 18th international conference on 3D web technology (Web3D ’13). ACM, San Sebastian ES, pp 135–138

    Google Scholar 

  • Polys NF, Bacim F, Setareh M, Jones B (2015) SAFAS: unifying form and structure through interactive 3D simulation. Eng Design Graph J 79:1–23

    Google Scholar 

  • Polys NF, Newcomb C, Schenk T, Skuzinski T, Dunay D (2018) The value of 3D models and immersive technology in planning urban density. In: Proceedings of the 23rd international ACM conference on 3D web technology (Web3D ’18). ACM, New York, NY, USA, Article 13, 4 pp. https://doi.org/10.1145/3208806.3208824

  • Popovici DM, Hamza-Lup FG, Seitan A, Bogdan CM (2012) Comparative study of APIs and frameworks for haptic application development. In: 12th international conference on cyberworlds, Darmstadt, Germania, 25–27 Sept 2012, pp 37–44

    Google Scholar 

  • Proske U, Gandevia SC (2012) The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. Physiol Rev 92(4):1651–1697

    Article  Google Scholar 

  • Rosen A (2009) e-Learning 2.0: proven practices and emerging technologies to achieve real results, AMACOM, 2009. ISBN 0814410731

    Google Scholar 

  • Sense S (2018) Take your world from physical to digital with 3D scanning. https://www.3dsystems.com/3d-scanners/sense-scanner. Accessed 2 Sept 2018

  • Setareh M, Jones B, Ma L, Bacim F, Polys N (2015) Application and evaluation of double-layer grid spatial structures for the engineering education of architects. J Architect Eng 21(3)

    Article  Google Scholar 

  • Smith A, Knizley A, Luck R (2017) A product dissection project designed for student motivation and retention in an introduction to engineering course. American Society for Engineering Education, San Juan, Puerto Rico, 2–5 Mar 2017

    Google Scholar 

  • SOFA (2018) Simulation open framework architecture—SOFA. http://www.sofa-framework.org. Accessed 2 Oct 2018

  • Steenkamp H, Nel AL, Carroll J (2017) Retention of engineering students. In: 2017 IEEE global engineering education conference (EDUCON), Athens, 2017, pp 693–698. https://doi.org/10.1109/educon.2017.7942922.

  • Titania (2018) Titania X3D editor—bring colours to your life. http://create3000.de/users-guide/. Accessed 5 Oct 2018

  • Takasaki M, Nara T, Tachi S, Higuchi T (2000) A tactile display using surface acoustic wave. In: Proceedings 9th IEEE international workshop on robot and human interactive communication, Osaka, Japan, 2000, pp 364–367

    Google Scholar 

  • Talvas A, Marchal M, Lecuyer A (2014) A survey on bimanual haptic interaction. IEEE Trans Haptics 7(3):285–300

    Article  Google Scholar 

  • Udin WS, Ahmad A (2012) Large scale mapping using digital aerial imagery of unmanned aerial vehicle. Int J Sci Eng Res 3:1–6

    Google Scholar 

  • Uttal DH, Cohen CA (2012) Spatial thinking and STEM education. In: The psychology of learning and motivation, vol 57, pp 147–181. ISSN: 0079–7421

    Chapter  Google Scholar 

  • Voss K, Musall E (2012) Net zero energy buildings—international projects of carbon neutrality in buildings, 2nd edn, Nov 2012. Institut fĂĽr Internationale Architektur-Dokumentation GmbH & Co. KG, MĂĽnchen. ISBN 978-3-920034-80-5

    Google Scholar 

  • WebGL (2018) The Khronos project—WebGL. https://www.khronos.org/webgl/. Accessed 5 Oct 2018

  • Wright R, Thompson WL, Ganis G, Newcombe NS, Kosslyn SM (2008) Training generalized spatial skills. Psychon Bull Rev 15:763–771

    Article  Google Scholar 

  • X3DOM (2018) What is X3DOM, and what can it do for me? https://doc.x3dom.org/gettingStarted/background/index.html. Accessed 5 Oct 2018

Download references

Acknowledgements

We would like to acknowledge Don Butzman and Nicholas Polys for discussions about the X3D standard and novel interaction techniques in the 3D space. This work was also facilitate by the Erasmus+ program for international cooperation between Georgia Southern University, US and Transilvania University of Brasov, Romania.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Felix G. Hamza-Lup .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hamza-Lup, F.G. (2019). Designing Knowledge Sharing Interfaces with Improved Interaction: Haptics and Web3D. In: Schaefer, D., Coates, G., Eckert, C. (eds) Design Education Today. Springer, Cham. https://doi.org/10.1007/978-3-030-17134-6_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-17134-6_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-17133-9

  • Online ISBN: 978-3-030-17134-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics