Skip to main content

Interference in Text Categorisation Experiments

  • Conference paper
  • First Online:
Quantum Interaction (QI 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8369))

Included in the following conference series:

  • 875 Accesses

Abstract

This article examines manual textual categorisation by human coders with the hypothesis that the law of total probability may be violated for difficult categories. An empirical evaluation was conducted to compare a one step categorisation task with a two step categorisation task using crowdsourcing. It was found that the law of total probability was violated. Both a quantum and classical probabilistic interpretations for this violation are presented. Further studies are required to resolve whether quantum models are more appropriate for this task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In the experiment, the reverse order, decide-then-categorise, and categorise only was investigated as well. We do not analyse the reverse order in this paper.

  2. 2.

    The image of \(\varPhi _i\) can be different, for example \(\varPhi _i : D \rightarrow \mathbb {R}\).

  3. 3.

    The restriction to six codes was imposed to keep the effort required to build the dataset within certain budgetary limits.

  4. 4.

    https://www.mturk.com/

  5. 5.

    The underscript \(\varOmega _2\) reminds us in which space the probabilities are computed.

  6. 6.

    For example, think about two loaded dice that contain a small magnet inside. Tossed separately, they work as fair dice; tossed together, the magnetic field influences the outcome.

References

  1. Townsend, J., Silva, K., Spencer-Smith, J., Wenger, M.: Exploring the relations between categorization and decision making with regard to realistic face stimuli. Pragmatics Cogn. 8, 83–105 (2000)

    Article  Google Scholar 

  2. Busemeyer, J.R., Wang, Z., Lambert-Mogiliansky, A.: Empirical comparison of markov and quantum models of decision making. J. Math. Psychol. 53, 423–433 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  3. Pothos, E.M., Busemeyer, J.R.: A quantum probability explanation for violations of ‘rational’ decision theory. Proc. R. Soc. 276, 2171–2178 (2009)

    Article  Google Scholar 

  4. Aerts, D.: Quantum structure in cognition. J. Math. Psychol. 53, 314–348 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  5. Khrennikov, A.: Ubiquitous Quantum Structure. Springer, Berlin (2010)

    Book  MATH  Google Scholar 

  6. Busemeyer, J., Pothos, E., Franco, R., Trueblood, J.: A quantum theoretical explanation for probability judgment errors. Psychol. Rev. 118, 193–218 (2011)

    Article  Google Scholar 

  7. Trueblood, J., Busemeyer, J.: A quantum probability explanation for order effects on inference. Cogn. Sci. 35, 1518–1552 (2011)

    Article  Google Scholar 

  8. Busemeyer, J., Bruza, P.: Quantum Cognition and Decision. Cambridge University Press, Cambridge (2012)

    Book  Google Scholar 

  9. Sebastiani, F.: Machine learning in automated text categorization. ACM Comput. Surv. 34, 1–47 (2002)

    Article  MathSciNet  Google Scholar 

  10. Hayes, P.J., Knecht, L.E., Cellio, M.J.: A news story categorization system. In: Proceedings of Association for Computational Linguistics, ALNC’88, Stroudsburg, PA, USA, pp. 9–17 (1988)

    Google Scholar 

  11. Alonso, O., Mizzaro, S.: Can we get rid of trec assessors? using mechanical turk for relevance assessment. In: SIGIR ’09: Workshop on the Future of IR, Evaluation (2009)

    Google Scholar 

  12. Alonso, O., Baeza-Yates, R.: Design and implementation of relevance assessments using crowdsourcing. In: Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., Mudoch, V. (eds.) ECIR 2011. LNCS, vol. 6611, pp. 153–164. Springer, Heidelberg (2011)

    Google Scholar 

  13. Grady, C., Lease, M.: Crowdsourcing document relevance assessment with mechanical turk. In: Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk (CSLDAMT ’10). Association for Computational Linguistics Stroudsburg, PA, USA, pp. 172–179 (2010)

    Google Scholar 

  14. Haven, E., Khrennikov, A.: Quantum Social Science. Cambridge University Press, Cambridge (2013)

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giorgio Maria Di Nunzio .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Di Nunzio, G.M., Bruza, P., Sitbon, L. (2014). Interference in Text Categorisation Experiments. In: Atmanspacher, H., Haven, E., Kitto, K., Raine, D. (eds) Quantum Interaction. QI 2013. Lecture Notes in Computer Science(), vol 8369. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54943-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-54943-4_3

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-54942-7

  • Online ISBN: 978-3-642-54943-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics