Abstract
Virtual reality (VR) technology has matured to a point where humans can navigate in virtual scenes; however, providing them with a comfortable fully immersive role in VR remains a challenge. Currently available sensing solutions do not provide ease of deployment, particularly in the seated position due to sensor placement restrictions over the body, and optic-sensing requires a restricted indoor environment to track body movements. Here we present a 52-sensor laden garment interfaced with VR, which offers both portability and unencumbered user movement in a VR environment. This chapter addresses the systems engineering aspects of our pervasive computing solution of the interactive sensorized 3D VR and presents the initial results and future research directions. Participants navigated in a virtual art gallery using natural body movements that were detected by their wearable sensor shirt and then mapped the signals to electrical control signals responsible for VR scene navigation. The initial results are positive, and offer many opportunities for use in computationally intelligentman-machine multimedia control.
Keywords
This research has been approved by the ethical committee of Macquarie University Sydney Australia, under the humans research ethical act of New South Wales, Australia, in approval letter No.HE23FEB2007-D05008 titled Personal Augmented Reality and Immersive System basedBody Machine Interface (PARIS based BMI).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
E. Beltrami. Sulle funzioni bilineari. Giornale di Mathematiche di Battaglini, 11:98–106, 1873.
I. Carreras, I. Chlamtac, F. De Pellegrini, and D. Miorandi. Bionets: Bio-inspired networking for pervasive communication environments. IEEE Transactions on Vehicular Technology, 56(1):218–229, 2007.
Coin 3D Graphics Development Library, www.coin3d.org/lib/downloads
Disability and rehabilitation (dar) team – assistive devices/technologies. www.who.int/disabilities/technology/en/index.html, World Health Organisation. 2007.
Disability and rehabilitation who action plan 2006–2011. www.who.int/disabilities/, World Health Organisation, 2007.
M. Dollarhide. Pervasive computing helps fans get into the game. IEEE Pervasive Computing, 6(3):7–10, 2007.
Electrically conductive liquid silicone rubber, Elastocil LR 3162, www.wacker.com/cms/en/products-markets/products/product.jsp?product=9091
I.A. Essa. Ubiquitous sensing for smart and aware environments. IEEE Personal Communications, 7(5):47–49, 2000.
E. Farella, D. Brunelli, L. Benini, B. Ricco, and M.E. Bonfigli. Pervasive computing for interactive virtual heritage. IEEE Multimedia, 12(3):46–58, 2005.
R.A. Fisher and W.A. Mckenzie. Studies in crop variation ii. the manurial response of different potato varieties. Journal of Agricultural Science, 13:311–320, 1923.
T. Gulrez and S. Challa. Relevant opportunistic information extraction and scheduling in heterogeneous sensor networks. In 1st IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (ICAMP 2005), Mexico City, 2005.
T. Gulrez and M. Kavakli. Precision position tracking in virtual reality environments using sensor networks. In IEEE International Symposium on Industrial Electronics, Vigo, 2007.
T. Gulrez and M. Kavakli. Sensor relevance establishment problem in shared information gathering sensor networks. In IEEE International Conference on Networking Sensing and Control (ICNSC’07), London, 2007.
T. Gulrez, M. Kavakli, and A. Tognetti. Robotics and virtual reality: A marriage of two diverse streams of science. In Computational Intelligence in Multimedia Processing: Recent Advances, 99–118. Springer, Heidelberg, 2008.
T. Gulrez, A. Tognetti, A. Fishbach, S. Acosta, C. Scharver, D. DeRossi, and F.A. Mussa-Ivaldi. Controlling wheelchairs by body motions: A learning framework for the adaptive remapping of space. In Proceedings of the International Conference on Cognitive Systems (CogSys 2008), Karlsruhe, 2008.
J. Hey and S. Carter. Pervasive computing in sports training. IEEE Pervasive Computing, 4(3):54, 2005.
H. Hotelling. Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology, 24:417–444, 498–520, 1933.
K. Jegers and M. Wiberg. Pervasive gaming in the everyday world. IEEE Pervasive Computing, 5(1):78–85, 2006.
A. Johnson, D. Sandin, G. Dawe, Z. Qiu, and D. Plepys. Developing the paris: Using the cave to prototype a new vr display. In Proceedings of IPT 2000, Ames, Iowa, June 2000.
M.C. Jordan. Memoire sur les formes bilineaires. Journal of Pure and Applied Mathematics, 19:35–54, 1874.
H.I. Krebs, M. Ferraro, S.P. Buerger, M.J. Newbery, A. Makiyama, M. Sandmann, D. Lynch, B.T. Volpe, and N. Hogan. Rehabilitation robotics: Pilot trial of a spatial extension for mit-manus. Journal of NeuroEngineering and Rehabilitation, 1(5), 2004.
F. Lorussi. Analysis and synthesis of human movement: Wearable kinesthetic interfaces. PhD thesis, DSEA, University of Pisa, 2003.
F. Lorussi, W. Rocchia, E. P Scilingo, A. Tognetti, and D. De Rossi. Wearable redundant fabric-based sensors arrays for reconstruction of body segment posture. IEEE Sensors Journal, 4(6):807–818, 2004.
F. Lorussi, E.P. Scilingo, M. Tesconi, A. Tognetti, and D. De Rossi. Strain sensing fabric for hand posture and gesture monitoring. IEEE Transactions On Information Technology In Biomedicine, 9(3):372–381, September 2005.
D. Marculescu, R. Marculescu, N.H. Zamora, P. Stanley-Marbell, P.K. Khosla, S. Park, S. Jayaraman, S. Jung, C. Lauterbach, W. Weber, T. Kirstein, D. Cottet, J. Grzyb, G. Troster, M. Jones, T. Martin, and Z. Nakad. Electronic textiles: A platform for pervasive computing. Proceedings of the IEEE, 91(12):1995–2018, 2003.
MathWorks. xPC Target, www.mathworks.com/products/xpctarget/
Matlab simulink. www.mathworks.com
F.A. Mussa-Ivaldi, A. Fishbach, T. Gulrez, A. Tognetti, and D. De-Rossi. Remapping the residual motor space of spinal-cord injured patients for the control of assistive devices. In Neuroscience 2006, Atlanta, Georgia, 14–18, 2006.
F.A. Mussa-Ivaldi and L.E. Miller. Brain machine interfaces: Computational demands and clinical needs meet basic neuroscience. Review, Trends in Neuroscience, 26:329–334, 2003.
National Instruments, Multi-function Data Acquisition, www.ni.com/dataacquisition/
K. Pearson. On lines and planes of closest fit to systems of points in space. Philosophical Magazine, (6)2:559–572, 1901.
E.R. Post, M. Orth, P.R. Russo, and N. Gershenfeld. Design and fabrication of textile-based computing. IBM System Journal, 39(3–4), 2000.
R.W. Stevens. TCP/IP Illustrated. Addison-Wesley, ISBN 0201633469, 1994.
S. Takezawa, T. Gulrez, D. Herath, and G. Dissanayke. Environmental recognition for autonomous robot using slam real time path planning with dynamical localised voronoi division. Transactions of the Japan Society of Mechanical Engineers (JSME), 3:904–910, 2005.
S. Teller, Jiawen Chen, and H. Balakrishnan. Pervasive pose-aware applications and infrastructure. IEEE Computer Graphics and Applications, 23(4):14–18, 2003.
A. Tognetti, F. Lorussi, R. Bartalesi, S. Quaglini, M. Tesconi, G. Zupone, and D. De Rossi. Wearable kinesthetic system for capturing and classifying upper limb gesture in post-stroke rehabilitation. Journal of NeuroEngineering and Rehabilitation, 2(8), 2005.
CAVELib\({}^{{}^{\mbox{ TM}} }\) for interactive 3D environments, www.mechdyne.com/integratedSolutions/software/products/CAVELib/CAVELib.htm
World report on disability and rehabilitation. Concept Paper, www.who.int/disabilities/, World Health Organisation, 2007.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag London Limited
About this chapter
Cite this chapter
Gulrez, T., Tognetti, A., De Rossi, D. (2009). Sensorized Garment Augmented 3D Pervasive Virtual Reality System. In: Hassanien, AE., Abawajy, J., Abraham, A., Hagras, H. (eds) Pervasive Computing. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-84882-599-4_5
Download citation
DOI: https://doi.org/10.1007/978-1-84882-599-4_5
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-598-7
Online ISBN: 978-1-84882-599-4
eBook Packages: Computer ScienceComputer Science (R0)