Skip to main content

Video-Based Deception Detection

  • Chapter
Intelligence and Security Informatics

Part of the book series: Studies in Computational Intelligence ((SCI,volume 135))

Abstract

This chapter outlines an approach for automatically extracting behavioral indicators from video and explores the possibility of using those indicators to predict human-interpretable judgments of involvement, dominance, tenseness, and arousal. The team utilized two-dimensional spatial inputs extracted from video to construct a set of discrete and inter-relational features. Then three predictive models were created using the extracted features as predictors and human-coded perceptions of involvement, tenseness, and arousal as the criterion. Through this research, the team explores the feasibility and validity of the approach and identifies how such an approach could contribute to the broader community.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bavelas, J.B.: Situations that lead to disqualification. Human Communication Research 9(2), 130–145 (1983)

    Article  Google Scholar 

  2. Birdwhistell, R.L.: Background to kinesics. ETC 13, 10–18 (1955)

    Google Scholar 

  3. Birdwhistell, R.L.: Kinesics and Context. University of Pennsylvania Press, Philadelphia (1970)

    Google Scholar 

  4. Burgoon, J.K.: Nonverbal signals. In: Knapp, K.L., Miller, G.R. (eds.) Handbook of interpersonal communication, Sage, Beverly Hills, CA, pp. 344–390 (1994)

    Google Scholar 

  5. Burgoon, J.K., Hale, J.L.: The fundamental topoi of relational messages. Communication Monographs 51, 193–214 (1984)

    Google Scholar 

  6. Burgoon, J.K., Le Poire, B.A.: Nonverbal cues and interper-sonal judgments: Participant and observer perceptions of intimacy, dominance, composure, and formality. Communication Monographs 66, 105–124 (1999)

    Google Scholar 

  7. Burgoon, J.K., Newton, D.A.: Applying a social meaning model to relational messages of conversational involvement: Comparing participant and observer perspectives. Southern Communication Journal 56, 96–113 (1991)

    Google Scholar 

  8. Burgoon, J.K., Birk, T., Pfau, M.: Nonverbal behaviors, per-suasion, and credibility. Human Communication Research 17(1), 140–169 (1990)

    Article  Google Scholar 

  9. Burgoon, J.K., Johnson, J.L., Koch, P.T.: The nature and measurement of interpersonal dominance. Communication Monographs 65, 308–335 (1998)

    Article  Google Scholar 

  10. Burgoon, J.K., Blair, J.P., Qin, T., Nunamaker, J.F.: Detecting Deception Through Linguistic Analysis. In: Chen, H., Miranda, R., Zeng, D.D., Demchak, C.C., Schroeder, J., Madhusudan, T. (eds.) ISI 2003. LNCS, vol. 2665, Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  11. Burgoon, J.K., Blair, J.P., Moyer, E.: Effects of Communication Modality on Arousal, Cognitive Complexity, Behavioral Control and Deception Detection During Deceptive Episodes. In: Annual Meeting of the National Communication Association, Miami Beach, Florida (2003)

    Google Scholar 

  12. Burgoon, J.K., Adkins, M., Kruse, J., Jensen, M.L., Meservy, T.O., Twitchell, D.P., Deokar, A., Nunamaker, J.F.: An approach for intent identification by building on deception detection. In: Proceedings of the 38th Annual Hawaii International Conference on System Science (CD/ROM). Computer Society Press, Hawaii (2005)

    Google Scholar 

  13. Burgoon, J.K., Jensen, M.L., Kruse, J., Meservy, T.O., Nunamaker, J.F.: Deception and intention detection. In: Chen, H., Raghu, T.S., Ramesh, R., Vinze, A., Zeng, D. (eds.) Hand-books in Information Systems. Elsevier B.V., Amsterdam (2007)

    Google Scholar 

  14. Coker, D.A., Burgoon, J.K.: The nature of conversational involvement and nonverbal encoding patterns. Human Communication Research 13(4) (1987)

    Google Scholar 

  15. DePaulo, B., Lindsay, J.J., Malone, B.E., Muhlenbruck, L., Charlton, K., Cooper, H.: Cues to deception. Psychological Bulletin 129(1), 74–118 (2003)

    Article  Google Scholar 

  16. Ekman, P., Friesen, W.V.: Nonverbal leakage and clues to deception. Psychiatry 32, 88–106 (1969)

    Google Scholar 

  17. Frank, M.G., Feeley, T.H.: To catch a liar: Challenges for research in lie detection training. Journal of Applied Communication Research 31(1), 58–75 (2003)

    Article  Google Scholar 

  18. Gifford, R.: A lens-mapping framework for understanding the en-coding and decoding of interpersonal dispositions. Journal of Personality and Social Psychology 66, 398–412 (1994)

    Article  Google Scholar 

  19. Jensen, M.L., Meservy, T.O., Kruse, J., Burgoon, J.K., Nunamaker, J.F.: Identification of deceptive behavioral cues extracted from video. In: International IEEE Conference on Intelligent Transportation Systems, Vienna, Austria (2005)

    Google Scholar 

  20. Levine, T.R., Freeley, T.H., McCornack, S.A., Hughes, M., Harms, C.M.: Testing the Effects of Nonverbal Behavior Training on Accuracy in Deception Detection with the Inclusion of a Bogus Training Control Group. Western Journal of Communication 69(3), 203–217 (2005)

    Article  Google Scholar 

  21. Lu, S., Tsechpenakis, G., Metaxas, D.N.: Blob analysis of the head and hands: A method for deception detection. In: Hawaii International Conference on System Science (HICSS 2005), Hawaii (2005)

    Google Scholar 

  22. Meservy, T.O., Jensen, M.L., Kruse, J., Burgoon, J.K., Nunamaker, J.F.: Automatic extraction of deceptive behavioral cues from video. In: Kantor, P., Muresan, G., Roberts, F., Zeng, D.D., Wang, F.-Y., Chen, H., Merkle, R.C. (eds.) ISI 2005. LNCS, vol. 3495, Springer, Heidelberg (2005)

    Google Scholar 

  23. Trager, G.L.: The typology of paralanguage. Anthropological Linguistics 3, 17–21 (1961)

    Google Scholar 

  24. Scherer, K.R.: Methods of research on vocal communication: Paradigms and parameters. In: KRSaP, E. (ed.) Handbook of methods in nonverbal behavior research, pp. 136–198. Cambridge University Press, Cambridge (1982)

    Google Scholar 

  25. Schmitt, N.: Uses and abuses of coefficient alpha. Psychological Assessment 8(4), 350–353 (1996)

    Article  Google Scholar 

  26. Swets, J.A.: Enhancing diagnostic decisions. In: Connolly, T., Arkes, H.R., Hammond, K.R. (eds.) Judgment and Decision Making: An Interdisciplinary Reader. Cambridge University Press, Cambridge (2000)

    Google Scholar 

  27. Vrij, A.: Detecting lies and deceit: The psychology of lying and implications for professional practice. John Wiley & Sons, Chichester (2000)

    Google Scholar 

  28. Vrij, A., Edward, K., Bull, R.: Police officers’ ability to detect deceit: The benefit of indirect deception detection measures. Legal and Criminological Psychology 6(2), 185–196 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Hsinchun Chen Christopher C. Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Jensen, M.L., Meservy, T.O., Burgoon, J.K., Nunamaker, J.F. (2008). Video-Based Deception Detection. In: Chen, H., Yang, C.C. (eds) Intelligence and Security Informatics. Studies in Computational Intelligence, vol 135. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69209-6_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-69209-6_22

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-69207-2

  • Online ISBN: 978-3-540-69209-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics