Modified Type-2 Fuzzy Gesture Space Induced Physical Disorder Recognition

  • Sriparna SahaEmail author
  • Pratyusha Rakshit
  • Amit Konar
Part of the Studies in Computational Intelligence book series (SCI, volume 837)


Gestures of a person symbolizing analogous physical disorder are not always exclusive. The gestural features of a subject suffering from the same physical disorder exhibit wide deviations for different instances. In presence of two or more gestural features, the variation of the attributes together makes the problem of physical disorder recognition more convoluted. This fluctuation is the main source of uncertainty in the physical disorder recognition problem, which has been addressed here using Type-2 Fuzzy Sets. First a type-2 fuzzy gesture space is assembled with the background knowledge of gestural features of different subjects for different physical disorders. Second, the physical disorder of an unknown gestural expression is concluded based on the consensus of the measured gestural features with the fuzzy gesture space. A fusion of Interval and General Type-2 Fuzzy Sets has been used to construct the fuzzy gestural space. The Interval Type-2 Fuzzy Set involves primary membership functions for M gestural features obtained from N subjects, each having L instances of gestural expressions for a given physical disorder. Along with that, the General Type-2 Fuzzy Set also includes the secondary memberships for individual primary membership curve, which has been obtained here by formulating and solving an optimization problem. To accomplish this, we have used Artificial Bee Colony. The secondary membership of a given source, characterizing the reliability in its primary membership assignment, is resolved based on the amalgamated knowledge of all the subjects’ primary membership functions. The adopted modified Type-2 Fuzzy Set-based uncertainty management strategy using gender independent training and testing databases has resulted in a classification accuracy of 93.48%.



The funding of University Grant Commission, University of Potential for Excellence Program (Phase II) in Cognitive Science, Jadavpur University, India are greatly acknowledged for the present work.


  1. 1.
    Acampora, Giovanni, Daniyal Alghazzawi, Hani Hagras, and Autilia Vitiello. 2016. An interval type-2 fuzzy logic based framework for reputation management in peer-to-peer e-commerce. Information Sciences 333: 88–107.CrossRefGoogle Scholar
  2. 2.
    Basturk, Bahriye. 2006. An artificial bee colony (abc) algorithm for numeric function optimization. In IEEE Swarm Intelligence Symposium, 2006, Indianapolis, IN, USA.Google Scholar
  3. 3.
    Bickel, P.J., and K.A. Doksum. 1977. Mathematical Statistics Holden-Day. SF: Inc.Google Scholar
  4. 4.
    Burba, Nathan, Mark Bolas, David M. Krum, and Evan A. Suma. 2012. Unobtrusive measurement of subtle nonverbal behaviors with the microsoft kinect. In 2012 IEEE Virtual reality short papers and posters (VRW), 1–4. IEEE.Google Scholar
  5. 5.
    Chakraborty, Aruna, Amit Konar, Uday Kumar Chakraborty, and Amita Chatterjee. 2009. Emotion recognition from facial expressions and its control using fuzzy logic. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 39 (4): 726–743.CrossRefGoogle Scholar
  6. 6.
    Chen, Chen-Tung and Wei-Zhan Hung. 2017. Evaluating the service quality of hospital by using topsis with interval type-2 fuzzy sets. In 2017 International Conference on Fuzzy Theory and its Applications (iFUZZY), 1–5. IEEE.Google Scholar
  7. 7.
    Clark, Ross A., Yong-Hao Pua, Karine Fortin, Callan Ritchie, Kate E. Webster, Linda Denehy, and Adam L. Bryant. 2012. Validity of the microsoft kinect for assessment of postural control. Gait & Posture 36 (3): 372–377.CrossRefGoogle Scholar
  8. 8.
    Das, Swagatam, Ajith Abraham, Uday K. Chakraborty, and Amit Konar. 2009. Differential evolution using a neighborhood-based mutation operator. IEEE Transactions on Evolutionary Computation 13 (3): 526–553.CrossRefGoogle Scholar
  9. 9.
    Dietterich, Thomas G. 1998. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10 (7): 1895–1923.CrossRefGoogle Scholar
  10. 10.
    Galna, Brook, Gillian Barry, Dan Jackson, Dadirayi Mhiripiri, Patrick Olivier, and Lynn Rochester. 2014. Accuracy of the microsoft kinect sensor for measuring movement in people with parkinson’s disease. Gait & Posture 39 (4): 1062–1068.CrossRefGoogle Scholar
  11. 11.
    García, Salvador, Daniel Molina, Manuel Lozano, and Francisco Herrera. 2009. A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the cec’2005 special session on real parameter optimization. Journal of Heuristics 15 (6): 617.CrossRefGoogle Scholar
  12. 12.
    Halder, Anisha, Amit Konar, Rajshree Mandal, Aruna Chakraborty, Pavel Bhowmik, Nikhil R. Pal, and Atulya K. Nagar. 2013. General and interval type-2 fuzzy face-space approach to emotion recognition. IEEE Transactions on Systems, Man, and Cybernetics: Systems 43 (3): 587–605.CrossRefGoogle Scholar
  13. 13.
    Halder, Anisha, Pratyusha Rakshit, Sumantra Chakraborty, Amit Konar, Aruna Chakraborty, Eunjin Kim, and Atulya K. Nagar. 2012. Reducing uncertainty in interval type-2 fuzzy sets for qualitative improvement in emotion recognition from facial expressions. In 2012 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 1–8. IEEE.Google Scholar
  14. 14.
    Kim, Dae-Jin, Sang-Wan Lee, and Zeungnam Bien. 2005. Facial emotional expression recognition with soft computing techniques. In The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ’05, 737–742. IEEE.Google Scholar
  15. 15.
    Klir, George, and Bo Yuan. 1995. Fuzzy Sets and Fuzzy Logic, vol. 4. NJ: Prentice Hall.Google Scholar
  16. 16.
    Lai, Kam, Janusz Konrad, and Prakash Ishwar. 2012. A gesture-driven computer interface using kinect. In 2012 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), 185–188. IEEE.Google Scholar
  17. 17.
    Le, Thi-Lan, Minh-Quoc Nguyen, et al. 2013. Human posture recognition using human skeleton provided by kinect. In 2013 International Conference on Computing, Management and Telecommunications (ComManTel), 340–345. IEEE.Google Scholar
  18. 18.
    Lee, Ching-Hung, Jang-Lee Hong, Yu-Ching Lin, and Wei-Yu. Lai. 2003. Type-2 fuzzy neural network systems and learning. International Journal of Computational Cognition 1 (4): 79–90.Google Scholar
  19. 19.
    Lisetti, Christine L., and David E. Rumelhart. 1998. Facial expression recognition using a neural network. In FLAIRS Conference, 328–332.Google Scholar
  20. 20.
    Martin, Chris C., Dan C. Burkert, Kyung R. Choi, Nick B. Wieczorek, Patrick M. McGregor, Richard A. Herrmann, and Peter A. Beling. 2012. A real-time ergonomic monitoring system using the microsoft kinect. In 2012 IEEE Systems and Information Design Symposium (SIEDS), 50–55. IEEE.Google Scholar
  21. 21.
    Mendel, Jerry M. 2001. On the importance of interval sets in type-2 fuzzy logic systems. In Joint 9th IFSA World Congress and 20th NAFIPS International Conference, 2001, vol. 3, 1647–1652. IEEE.Google Scholar
  22. 22.
    Mendel, Jerry M., RI Bob John. 2002. Type-2 fuzzy sets made simple. IEEE Transactions on Fuzzy Systems 10 (2): 117–127.CrossRefGoogle Scholar
  23. 23.
    Mendel, Jerry M., Robert I. John, and Feilong Liu. 2006. Interval type-2 fuzzy logic systems made simple. IEEE Transactions on Fuzzy Systems 14 (6): 808–821.CrossRefGoogle Scholar
  24. 24.
    Metcalf, Cheryl D, Rebecca Robinson, Adam J. Malpass, Tristan P. Bogle, Thomas A. Dell, Chris Harris, and Sara H. Demain. 2013. Markerless motion capture and measurement of hand kinematics: validation and application to home-based upper limb rehabilitation. IEEE Transactions on Biomedical Engineering 60 (8): 2184–2192.CrossRefGoogle Scholar
  25. 25.
    Nixon, Mark, and Alberto S. Aguado. 2012. Feature Extraction and Image Processing for Computer Vision. Academic Press.Google Scholar
  26. 26.
    Olivas, Frumen, Fevrier Valdez, Oscar Castillo, Claudia I. Gonzalez, Gabriela Martinez, and Patricia Melin. 2017. Ant colony optimization with dynamic parameter adaptation based on interval type-2 fuzzy logic systems. Applied Soft Computing 53: 74–87.CrossRefGoogle Scholar
  27. 27.
    Oszust, Mariusz, and Marian Wysocki. 2013. Recognition of signed expressions observed by kinect sensor. In 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 220–225. IEEE.Google Scholar
  28. 28.
    Parajuli, Monish, Dat Tran, Wanli Ma, and Dharmendra Sharma. 2012. Senior health monitoring using kinect. In 2012 Fourth International Conference on Communications and Electronics (ICCE), 309–312. IEEE.Google Scholar
  29. 29.
    Quante, Markus, Stephanie Hille, Markus D. Schofer, Jürgen Lorenz, and Michael Hauck. 2008. Noxious counterirritation in patients with advanced osteoarthritis of the knee reduces mcc but not sii pain generators: A combined use of meg and eeg. Journal of Pain Research 1:1.Google Scholar
  30. 30.
    Rakshit, Pratyusha, Aruna Chakraborty, Amit Konar, and Atulya K. Nagar. 2013. Secondary membership evaluation in generalized type-2 fuzzy sets by evolutionary optimization algorithm. In 2013 IEEE International Conference on Fuzzy Systems (FUZZ), 1–8. IEEE.Google Scholar
  31. 31.
    Rakshit, Pratyusha, Amit Konar, Archana Chowdhury, Eunjin Kim, and Atulya K. Nagar. 2013. Muti-objective evolutionary approach of ligand design for protein-ligand docking problem. In 2013 IEEE Congress on Evolutionary Computation (CEC), 237–244. IEEE.Google Scholar
  32. 32.
    Rakshit, Pratyusha, Amit Konar, Swagatam Das, Lakhmi C Jain, and Atulya K. Nagar. 2014. Uncertainty management in differential evolution induced multiobjective optimization in presence of measurement noise. IEEE Transactions on Systems, Man, and Cybernetics: Systems 44 (7): 922–937.CrossRefGoogle Scholar
  33. 33.
    Rakshit, Pratyusha, Amit Konar, Swagatam Das, and Atulya K. Nagar. 2013. Abc-tdql: An adaptive memetic algorithm. In Hybrid Intelligent Models and Applications (HIMA), 35–42. IEEE.Google Scholar
  34. 34.
    Saha, Sriparna, Monalisa Pal, Amit Konar, and Ramadoss Janarthanan. 2013. Neural network based gesture recognition for elderly health care using kinect sensor. In International Conference on Swarm, Evolutionary, and Memetic Computing, 376–386. Springer.Google Scholar
  35. 35.
    Stone, Erik E., and Marjorie Skubic. 2015. Fall detection in homes of older adults using the microsoft kinect. IEEE Journal of Biomedical and Health Informatics 19 (1): 290–301.CrossRefGoogle Scholar
  36. 36.
    Tong, Jing, Jin Zhou, Ligang Liu, Zhigeng Pan, and Hao Yan. 2012. Scanning 3d full human bodies using kinects. IEEE Transactions on Visualization and Computer Graphics 18 (4): 643–650.CrossRefGoogle Scholar
  37. 37.
    Wagner, Christian, Hani Hagras, et al. 2010. Toward general type-2 fuzzy logic systems based on zslices. IEEE Transactions on Fuzzy Systems 18 (4): 637–660.CrossRefGoogle Scholar
  38. 38.
    Xiaoyi Yu, Lingyi Wu, Qingfeng Liu, and Han Zhou. 2011. Children tantrum behaviour analysis based on kinect sensor. In 2011 Third Chinese Conference on Intelligent Visual Surveillance (IVS) 49–52. IEEE.Google Scholar
  39. 39.
    Zadeh, Lotfi A., et al. 1965. Fuzzy sets. Information and Control 8 (3): 338–353.MathSciNetCrossRefGoogle Scholar
  40. 40.
    Zar, Jerrold H., et al. 1999. Biostatistical Analysis. Pearson Education India.Google Scholar
  41. 41.
    Zhai, Daoyuan, and Jerry M. Mendel. 2011. Uncertainty measures for general type-2 fuzzy sets. Information Sciences 181 (3): 503–518.MathSciNetCrossRefGoogle Scholar
  42. 42.
    Zhang, Zhengyou. 2012. Microsoft kinect sensor and its effect. IEEE Multimedia 19 (2): 4–10.CrossRefGoogle Scholar
  43. 43.
    Zimmermann H.-J. 1996. Fuzzy control. In Fuzzy Set Theory–and Its Applications, 203–240. Springer.Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Computer Science and Engineering DepartmentMaulana Abul Kalam Azad University of TechnologyKolkataIndia
  2. 2.Electronics and Tele-communication Engineering DepartmentJadavpur UniversityKolkataIndia

Personalised recommendations