Rule Based Trajectory Segmentation Applied to an HMM-Based Isolated Hand Gesture Recognizer
In this paper, we propose a simple but effective method of modeling hand drawn gestures based on their angles and curvature of the trajectories. Each gesture trajectory is composed of a unique series of straight and curved segments. In our Hidden Markov Model (HMM) implementation, these gestures are modeled as connected series of states analogous to series of phonemes in speech recognition. The novelty of the work presented here is the automated process we developed in segmenting gesture trajectories based on a simple set of threshold values in curvature and accumulated curvature angle. In order to represent its angular distribution of each separated states, the von Mises distribution is used. Likelihood based state segmentation was implemented in addition to the threshold based method to ensure that gesture sets are segmented consistently. The proposed method can separate each angular state of training data at the initialization step, thus providing a solution to mitigate ambiguity on initializing HMM. For comparative studies, the proposed automated state segmentation based HMM initialization was considered over the conventional method. Effectiveness of the proposed method is shown as it achieved higher recognition rates in experiments over conventional methods.
KeywordsTrajectory segmentation hand gesture recognition hidden Markov model HMM initialization
Unable to display preview. Download preview PDF.
- 2.Garg, P., Aggarwal, N., Sofat, S.: Vision based hand gesture recognition. World Academy of Science, Engineering and Technology 49 (2009)Google Scholar
- 5.Lee, J.J., Kim, J., Kim, J.H.: Data-driven design of HMM topology for on-line handwriting recognition. In: The Proceedings of 7th International Workshop on Frontiers in Handwriting Recognition, pp. 239–248 (2000)Google Scholar
- 6.Gunter, S., Bunke, H.: Optimizing the number of states, training iterations and Gaussian s in an HMM-based Handwritten Word Recognizer. In: The Proceedings of the 7th International Conference on Document Analysis and Recognition (2003)Google Scholar