Skip to main content

Advertisement

SpringerLink
Log in

Experimental evaluation of haptic data communication with prediction

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The transmission of haptic data is relatively challenging in multimedia communication. In this research study, the methods are presented for exploiting the properties of human haptic perception for data reduction of haptic data transmission. Packet-switched communication of haptic data is characterized by high packet rates on the communication channel. The quality of the internet-based haptic tele-control/tele-presence systems is highly dependent on the quality of the communication channel between the operator and the remote site, and on the delay jitter in the data exchange. The proposed research work is evaluated experimentally using a Geomagic Touch (previously PHANTOM Sensable Omni) haptic device with a sphere as a virtual model. Four experiments were conducted to evaluate the proposed research study. In the first experiment the JND Weber’s law is applied on sent force values only, while in the second experiment, the force calculation algorithm has been modified to include human movement velocity. The third experiment discusses the use of JND on the sent velocity values. The evaluation of the human’s perception shows that the proposed modification to the basic dead-band approach highly reduces the number of sent packets with minimal disturbance in haptic feeling. Further enhancements using prediction techniques have also been introduced in the fourth experimental evaluation. The linear predictions are added to the above proposed reduction methods. Combining the dead-band approach with a fast, configurable and accurate prediction algorithm enables a significant reduction in the amount of data sent across the network. The reduction is estimated to be 85%, while preserving the original data structure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Awed J, Elhajj IH, Chehab A, Kayssi A (2013) Perception-aware packet-loss resilient compression for networked haptic systems. Comput Commun 36(15–16):1621–1628

    Article  Google Scholar 

  2. Boukerche A, Maamar H, Hossain A (2008) An efficient hybrid multicast transport protocol for collaborative virtual environment with networked haptic. Multimedia Systems 4(4):283–296

    Article  Google Scholar 

  3. Boukherche A, Shirmohammadi S, Hossain A (2006) Moderating simulation lag in haptic virtual environments. Presented at the 39th simulation symposium, Huntsville, USA, April 2–6

  4. Brandi F, Steinbach E (2013) Prediction techniques for haptic communication and their vulnerability to packet losses. In: Proceedings of the IEEE international workshop on haptic audio visual environments and games, Istanbul, Turkey, pp 63–68

  5. Cha J, Ho YS, Kim Y, Ryu J, Oakley I (2009) A framework for haptic broadcasting. IEEE Multimedia 16(3):477–491

    Article  Google Scholar 

  6. Haykin S, Moher M (2009) Communication systems, 5. Wiley & Sons, New York. ISBN-13: 978-0471697909, ISBN-10: 0471697907

  7. Hinterseer P, Hirche S, Chaudhuri S, Steinbach E, Buss M (2008) Perception-based data reduction and transmission of haptic data in telepresence and teleaction systems. IEEE Trans Signal Process 56(2):588–597

    Article  MathSciNet  MATH  Google Scholar 

  8. Hirche S, Buss M (2007) Transparent data reduction in networked telepresence and teleaction systems. Part II: time delayed communication. Presence 16(5):532–542

    Article  Google Scholar 

  9. Hirche S, Hinterseer P, Steinbach E, Buss M (2007) Transparent data reduction in networked telepresence and teleaction systems. Part I: communication without time delay. Presence: Teleoperators Virtual Environ 16(5):523–531

    Article  Google Scholar 

  10. Hosseini ZM (2009) Factors affecting human force perception and performance in haptic-enabled virtual environments. PhD thesis, Electrical and Computer Engineering, Waterloo, Canada

  11. Janabi-Sharifi F, Hayward V, Chen C-SJ (2000) Discrete – time adaptive windowing for velocity estimation. IEEE Trans Control Syst Technol 8(6):1003–1009

    Article  Google Scholar 

  12. Kammerl J, Vittorias I, Nitsch V, Faerber B, Steinbach E, Hirche S (Presence, 2010) Perception-based data reduction for haptic force-feedback signals using velocity-adaptive deadbands. 19(5):450–462

  13. Kammerl J, Chaudhari R, Steinbach E (2011) Combining contact models with perceptual data reduction for efficient haptic data communication in networked VEs. IEEE Trans Instrum Meas 60(1):57–68

    Article  Google Scholar 

  14. Klatzky RL, Lederman SJ (2003) “Touch”, experimental psychology, vol. 4. In: Weiner IB (ed) Handbook of psychology. Wiley, New York, pp 147–176

    Google Scholar 

  15. Kron A, Schmidt G, Petzold B, Zah MF, Hinterseer P, Steinbach E Disposal of explosive ordnances by use of a bimanual haptic telepresence system. In Proceeding of IEEE international conference on robotics and automation, New Orleans, LA, USA, USA, April 26 to May 2004, pp 1968–1973

  16. Mirfakhrai T, Payandeh S (2005) On using delay prediction in controlling force reflecting teleoperation over the internet. Robotica 23(6):809–813

    Article  Google Scholar 

  17. Nakano T, Uozumi S, Johansson R (2015) A quantization method for haptic data lossy compression. 2015 I.E. International Conference on Mechatronics (ICM), Nagoya, Japan, 6–8

  18. OpenHaptics Toolkit Programmers’s Guide version 3.3 [online]. Available on http://www.arscontrol.org/uploads/federica/OpenHaptics Toolkit_API Reference Manual.pdf

  19. Ortega A, Liu Y (2002) Lossy compression of haptic data. In: McLaughlin GSM, Hespanha J (eds) Touch in virtual environments: haptics and the Design of Interactive Systems. Prentice-Hall, Englewood Cliffs, pp 119–136 ch. 6

    Google Scholar 

  20. Osman HA, Eid M, Saddik AE (2008) Evaluating ALPHAN with multi-user collaboration. Proceeding of 12th IEEE/ACM international symposium on distributed simulation and real-time applications, Vancouver, BC, Canada, 27–29, pp 181–186

  21. Osman HA, Eid M, Iglesias R, Saddik AE (2007) ALPHAN: Application Layer Protocol for Haptic Networking. Proceeding of IEEE international workshop on Haptic audio Visual Environments and their applications (HAVE’2007) – Ottawa, Canada, 12–14

  22. Otanez PG, Moyne JR, Tilbury DM (2002) Using deadbands to reduce communications in networked control systems. Proceedings of the American control conference; Anchorage, USA, 8–10, pp 3015–3020

  23. Saddik AE, Eid M, Cha J (2011) Admux: an adaptive multiplexer for haptic - audio - visual data communication. IEEE Trans Instrum Meas 60(1):21–31

    Article  Google Scholar 

  24. Shahabi C, Ortega A, Kolahdouzan MR (2002) A comparison of different haptic compression techniques. In Proceeding IEEE int. conf. multimedia expo, Lausanne, Switzerland, 26–29, pp 657–660

  25. Souayed RT, Gaiti D, Pujolle G (2003) Haptic virtual environment performance over IP networks: a case study. Proceedings of 7th IEEE international symposium on distributed simulation and real- time applications, Delft, Netherlands, 23–25

  26. Tee TH, Yap KM, Marshall A (2014) A quantitative evaluation of haptic data prediction techniques over best-effort network. Proceedings of the 16th International Conference on Advanced Communications Technology (ICACT2014), Phoenix Park, Pyeongchang, South Korea, February 16–19

  27. Tee TH, Yap KM, Marshall A (2014) A quantitative evaluation of haptic data prediction techniques over best-effort network. 16th International Conference on Advanced Communication Technology (ICACT), Pyeongchang, South Korea, 16–19

  28. The dummynet project [online]. Available on “http://info.iet.unipi.it/~luigi/dummynet”

  29. The Touch™ Haptic Device [online]. Available on “http://www.geomagic.com/en/products/phantom-omni/overview/”]

  30. Tsuji T, Yamada M, Kaneko Y (2013) A robot measuring upper limb range of motion for rehabilitation database. J Rob Mechatronics 25(3):515–520

    Article  Google Scholar 

  31. Vittorias I, Kammerl J, Hirche S, Steinbach E (2009) Perceptual coding of haptic data in time-delayed teleoperation. Proceeding world haptics, Salt Lake City, UT, USA, 18–20, pp 208–213

  32. Vittorias I, Kammerl J, Hirche S, Steinbach E (2009) Perceptual coding of haptic data in time-delayed tele-operation. Third Joint EuroHaptics conference, Symposium on haptic interfaces for virtual environment and teleoperator systems, Salt Lake City, UT, USA, 18–20

  33. Xu X, Cizmeci B, Schuwerk C (2015) Haptic data reduction for time-delayed teleoperation using the time domain passivity approach. 2015 I.E. World Haptics Conference (WHC), Evanston, IL, USA, 22–26

  34. You Y, Sung MY (2008) Haptic data transmission based on the prediction and compression. ICC '08. IEEE international conference on communications, Beijing, China, 19–23

  35. You Y, Mee YS, Jun K (2007) A scheme for haptic data transmission under various network conditions. Proceeding of IEEE international conference on multimedia and expo, Beijing, China, 2–5

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, University Of Sharjah, Sharjah, United Arab Emirates

    Qassim Nasir

  2. ITC – MIS, University of Sharjah, Sharjah, United Arab Emirates

    Enas Khalil

Authors
  1. Qassim Nasir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Enas Khalil
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qassim Nasir.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nasir, Q., Khalil, E. Experimental evaluation of haptic data communication with prediction. Multimed Tools Appl 77, 25005–25025 (2018). https://doi.org/10.1007/s11042-018-5743-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5743-9

Keywords

Search

Navigation