Abstract
We propose a data-driven, unobtrusive and covert method for automatic deception detection in interrogation interviews from visual cues only. Using skin blob analysis together with Active Shape Modeling, we continuously track and analyze the motion of the hands and head as a subject is responding to interview questions, as well as their facial micro expressions, thus extracting motion profiles, which we aggregate over each interview response. Our novelty lies in the representation of the motion profile distribution for each response. In particular, we use a kernel density estimator with uniform bins in log feature space. This scheme allows the representation of relatively over-controlled and relatively agitated behaviors of interviewed subjects, thus aiding in the discrimination of truthful and deceptive responses.
Chapter PDF
References
Ekman, P.: Telling lies: Clues to deceit in the marketplace, politics, and marriage, vol. 2. WW Norton and Company, New York (1992)
Zhang, Z., Singh, V., Slowe, T.E., Tulyakov, S., Govindaraju, V.: Real-time automatic deceit detection from involuntary facial expressions. In: IEEE CVPR (2007)
George, J., Biros, D.P., Burgoon, J.K., Nunamaker, J.: Training professionals to detect deception. In: NSF/NIJ Symposium on Intelligence and Security Informatics, Tucson, AZ (2003)
DePaulo, B., Lindsay, J., Muhlenbruck, L., Charlton, K., Cooper, H.: Cues to deception. Psychological Bulletin 129, 74–118 (2003)
Vrij, A.: Detecting lies and deceit: The psychology of lying and its implications for professional practice. Wiley, Chichester (2000)
Buller, D., Burgoon, J., White, C., Ebesu, A.: Interpersonal deception: VII. Behavioral Profiles of Falsification, Equivocation and Concealment. Journal of Language and Social Psychology 13, 366–395 (1994)
Ekman, P.: Lying and nonverbal behavior: Theoretical issues and new findings. Journal of Nonverbal Behavior 12, 163–176 (1988)
Vrij, A., Edward, K., Roberts, K., Bull, R.: Detecting deceit via analysis of verbal and nonverbal behavior. Journal of Nonverbal Behavior 24, 239–263 (2000)
Burgoon, J.K.: A communication model of personal space violations: Explication and an initial test. Human Communication Research 4, 129–142 (1978)
Buller, D., Burgoon, J.: Interpersonal deception theory. Communication Theory 6, 203–242 (1996)
Meservy, T.O., Jensen, M.L., Kruse, J., Burgoon, J.K., Nunamaker, J.F.: Automatic Extraction of Deceptive Behavioral Cues from Video. In: Kantor, P., Muresan, G., Roberts, F., Zeng, D.D., Wang, F.-Y., Chen, H., Merkle, R.C. (eds.) ISI 2005. LNCS, vol. 3495, pp. 198–208. Springer, Heidelberg (2005)
Buddharaju, P., Dowdall, J., Tsiamyrtzis, P., Shastri, D., Pavlidis, I., Frank, M.G.: Automatic thermal monitoring system (ATHEMOS) for deception detection. IEEE CVPR 2, 1179 (2005)
Johnson, R., Barnhardt, J., Zhu, J.: The contribution of executive processes to deceptive responding. Neuropsychologia 42, 878–901 (2004)
Kozel, F.A., Johnson, K.A., Mu, Q., Grenesko, E.L., Laken, S.J., George, M.S.: Detecting deception using functional magnetic resonance imaging. Biological Psychiatry 58, 605–613 (2005)
Ganis, G., Kosslyn, S.M., Stose, S., Thompson, W.L., Yurgelun-Todd, D.A.: Neural correlates of different types of deception: An fmri investigation. Cerebral Cortex 13, 830–836 (2003)
Lu, S., Tsechpenakis, G., Metaxas, D., Jensen, M.L., Kruse, J.: Blob analysis of the head and hands: A method for deception detection and emotional state identification. In: Hawaii International Conference on System Sciences, Big Island, Hawaii (2005)
Tsechpenakis, G., Metaxas, D., Adkins, M., Kruse, J., Burgoon, J., Jensen, M., Meservy, T., Twitchell, D., Deokar, A., Nunamaker, J.: HMM-based deception recognition from visual cues. In: IEEE ICME, pp. 824–827. IEEE, Los Alamitos (2005)
Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE 77, 257–286 (1989)
Ekman, P., Friesen, W.V.: Nonverbal leakage and clues to deception. Psychiatry 32, 88–106 (1969)
Buller, D.B., Burgoon, J.K., Buslig, A., Roiger, J.: Interpersonal deception: Viii. nonverbal and verbal correlates of equivocation from the bavelas et al (1990); research. Journal of Language and Social Psychology 13, 396–417 (1994)
Kanaujia, A., Huang, Y., Metaxas, D.: Tracking facial features using mixture of point distribution models. In: ICVGIP (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Michael, N., Dilsizian, M., Metaxas, D., Burgoon, J.K. (2010). Motion Profiles for Deception Detection Using Visual Cues. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6316. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15567-3_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-15567-3_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15566-6
Online ISBN: 978-3-642-15567-3
eBook Packages: Computer ScienceComputer Science (R0)