Skip to main content

Neural Networks Assist Crowd Predictions in Discerning the Veracity of Emotional Expressions

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2018)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11306))

Included in the following conference series:

Abstract

Crowd predictions have demonstrated powerful performance in predicting future events. We aim to understand crowd prediction efficacy in ascertaining the veracity of human emotional expressions. We discover that collective discernment can increase the accuracy of detecting emotion veracity from 63%, which is the average individual performance, to 80%. Constraining data to best-performers can further increase the result up to 92%. Neural networks can achieve an accuracy of 99.69% by aggregating participants’ answers. That is, assigning positive and negative weights to high and low human predictors, respectively. Furthermore, neural networks that are trained with one emotion data can also produce high accuracies on discerning the veracity of other emotion types: our crowdsourced transfer of emotion learning is novel. We find that our neural networks do not require a large number of participants, particularly, 30 randomly selected, to achieve high accuracy predictions, better than any individual participant. Our proposed method of assembling peoples’ predictions with neural networks can provide insights for applications such as fake news prevention and lie detection.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aviezer, H., Hassin, R., Bentin, S., Trope, Y.: Putting facial expressions back in context. In: First Impressions, pp. 255–286 (2008)

    Google Scholar 

  2. Chen, L., Gedeon, T., Hossain, M.Z., Caldwell, S.: Are you really angry?: detecting emotion veracity as a proposed tool for interaction. In: Proceedings of the 29th Australian Conference on Computer-Human Interaction, pp. 412–416. ACM (2017)

    Google Scholar 

  3. Conroy, N.J., Rubin, V.L., Chen, Y.: Automatic deception detection: methods for finding fake news. Proc. Assoc. Inf. Sci. Technol. 52(1), 1–4 (2015)

    Article  Google Scholar 

  4. Du, S., Martinez, A.M.: The resolution of facial expressions of emotion. J. Vis. 11(13), 24–24 (2011)

    Article  Google Scholar 

  5. Frood, A.: Work the crowd. New Sci. 237(3166), 32–35 (2018)

    Article  Google Scholar 

  6. Gagnon, M., Gosselin, P., Hudon-ven Der Buhs, I., Larocque, K., Milliard, K.: Children’s recognition and discrimination of fear and disgust facial expressions. J. Nonverbal Behav. 34(1), 27–42 (2010)

    Article  Google Scholar 

  7. Hassin, R.R., Aviezer, H., Bentin, S.: Inherently ambiguous: facial expressions of emotions, in context. Emot. Rev. 5(1), 60–65 (2013)

    Article  Google Scholar 

  8. Hossain, M.Z., Gedeon, T.: Classifying posed and real smiles from observers’ peripheral physiology. In: 11th International Conference on Pervasive Computing Technologies for Healthcare, Barcelona, Spain, pp. 177–186, May 2017

    Google Scholar 

  9. Manski, C.F.: Interpreting the predictions of prediction markets. Econ. Lett. 91(3), 425–429 (2006)

    Article  Google Scholar 

  10. Mather, M., Knight, M.R.: Angry faces get noticed quickly: threat detection is not impaired among older adults. J. Gerontol. Ser. B Psychol. Sci. Soc. Sci. 61(1), 54–57 (2006)

    Article  Google Scholar 

  11. McLellan, T., Johnston, L., Dalrymple-Alford, J., Porter, R.: Sensitivity to genuine versus posed emotion specified in facial displays. Cogn. Emot. 24(8), 1277–1292 (2010)

    Article  Google Scholar 

  12. Mellers, B., et al.: Identifying and cultivating superforecasters as a method of improving probabilistic predictions. Perspect. Psychol. Sci. 10(3), 267–281 (2015)

    Article  Google Scholar 

  13. Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)

    Article  Google Scholar 

  14. Polgreen, P.M., Nelson, F.D., Neumann, G.R., Weinstein, R.A.: Use of prediction markets to forecast infectious disease activity. Clin. Infect. Dis. 44(2), 272–279 (2007)

    Article  Google Scholar 

  15. Servan-Schreiber, E., Wolfers, J., Pennock, D.M., Galebach, B.: Prediction markets: does money matter? Electr. Markets 14(3), 243–251 (2004)

    Article  Google Scholar 

  16. Surowiecki, J.: The Wisdom of Crowds. Anchor (2005)

    Google Scholar 

  17. Svozil, D., Kvasnicka, V., Pospichal, J.: Introduction to multi-layer feed-forward neural networks. Chemom. Intell. Lab. Syst. 39(1), 43–62 (1997)

    Article  Google Scholar 

  18. Teixeira, T., Wedel, M., Pieters, R.: Emotion-induced engagement in internet video advertisements. J. Mark. Res. 49(2), 144–159 (2012)

    Article  Google Scholar 

  19. Wolfers, J., Zitzewitz, E.: Prediction markets. J. Econ. Perspect. 18(2), 107–126 (2004)

    Article  Google Scholar 

Download references

Acknowledgements

The authors are grateful to Aaron Manson for access to the data, and particularly acknowledge his efforts in data collection.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tom Gedeon .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Qin, Z., Gedeon, T., Caldwell, S. (2018). Neural Networks Assist Crowd Predictions in Discerning the Veracity of Emotional Expressions. In: Cheng, L., Leung, A., Ozawa, S. (eds) Neural Information Processing. ICONIP 2018. Lecture Notes in Computer Science(), vol 11306. Springer, Cham. https://doi.org/10.1007/978-3-030-04224-0_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-04224-0_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-04223-3

  • Online ISBN: 978-3-030-04224-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics