Skip to main content

Human Interactivity: Problem-Finding, Problem-Solving, and Verbal Patterns in the Wild

  • Chapter
  • First Online:
Book cover Cognition Beyond the Brain

Abstract

This chapter presents an interactivity -based approach to human problem-solving in the wild. It introduces the notion of ‘interactivity’, here defined as sense-saturated coordination that contributes to human action . On this view, interactivity is an ontological substrate that can be studied as interaction , as cognition , or as ecological niche production (section “Human Interactivity”). While the chapter theoretically argues in favour of a unified, anti-disciplinary approach to interactivity, it turns its attention to the cognitive ecology of human problem-solving. It does so by presenting a method of Cognitive Event Analysis (section “From Interactivity to Cognitive Events”), that leads to a detailed analysis of how a problem in the wild is being solved (section “The Invoice Case”). The analysis addresses the cognitive dynamics of how two persons in a work setting reach an insight into the nature of a problem, including the spatial organisation of the workplace, the interbodily dynamics between the two participants (especially in relation to gaze and the manual handling of papers), and verbal patterns that prompts them to simulate how the problem appears to a third party. The chapter concludes that human problem-solving is far less linear and planned than assumed in much work on the topic. Rather than problem-solving, it appears as solution-probing in real-time. The cognitive trajectory to a viable solution is thus self-organised, unplanned, and on the edge of chaos .

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Saussure was indeed correct when he, a century ago, established that “c’est le point de vue qui crée l’objet” (Saussure 1916/1973, p. 23).

  2. 2.

    For a fuller critique of Clark’s position, see Steffensen (2009, 2011).

  3. 3.

    In line with this view, Donald (2001) argues that humans alone developed a cultural capacity to voluntarily retrieve experience. Culture turns our social and physical environment into a cognitive resource, and not just an independent, external material resource. Therefore, studying cognition as a Distributed Cognitive System requires that we take into account longer time-scales than that of here-and-now situated interactions, for instance those involved in autobiographical memory (Donald 1991, 2001, 2012; cf. Cowley 2012), collective memory (Wertsch 2002) and cultural artefacts.

  4. 4.

    The light shake of the invoice is invisible in the still shots in Fig. 5.4, but a close examination of the 25 frames from the video recording reveals the movement.

  5. 5.

    The margin of error is 40 ms, or the time between two frames. The spectrogram (made in PRAAT software) shows with accuracy when the syllable starts, and this can be imposed on the frame-by-frame video annotation (made in ELAN software). This procedure shows that the hand movement at latest starts in the frame that immediately follows the frame in which the syllable starts.

References

  • Ball, L. J., & Litchfield, D. (this vol.). Interactivity and embodied cues in problem solving, learning and insight: Further contributions to a “theory of hints”.

    Google Scholar 

  • Bang, J. C., & Døør, J. (2007). Language, ecology and society: A dialectical approach. In S.V. Steffensen & J. Nash (Eds.). London: Continuum.

    Google Scholar 

  • Berkowitz, L. (2007). Frustration-aggression hypothesis. In R. F. Baumeister & K. D. Vohs (Eds.), Encyclopedia of social psychology (pp. 366–368). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Brorsen, A.-K. (2010). Til dialog… Unpublished elite module project. Odense: University of Southern Denmark.

    Google Scholar 

  • Bråten, S. (2009). The intersubjective mirror in infant learning and evolution of speech. Amsterdam: John Benjamins.

    Book  Google Scholar 

  • Chemero, A. (2000). What events are: Commentary on Stoffregen’s “Affordances and events”. Ecological Psychology, 12, 37–42.

    Article  Google Scholar 

  • Clark, A. (2008). Supersizing the mind: Embodiment, action and cognitive extension. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Clark, A., & Chalmers, D. (1998). The extended mind. Analysis, 58, 7–19.

    Article  Google Scholar 

  • Cowley, S. J. (1998). Of timing, turn-taking, and conversation. Journal of Psycholinguistic Research, 27, 541–571.

    Article  Google Scholar 

  • Cowley, S. J. (2011). Distributed language. In S. J. Cowley (Ed.), Disitributed language (pp. 1–14). Amsterdam: John Benjamins.

    Chapter  Google Scholar 

  • Cowley, S. J. (2012). Mimesis and language: A distributed view. Interaction Studies, 13, 17–40.

    Article  Google Scholar 

  • Crystal, D. (2008). A dictionary of linguistics and phonetics (6th ed.). Oxford: Blackwell.

    Book  Google Scholar 

  • Desai, V., Madsen, P. M., & Roberts, K. H. (2012). High-reliability organizations in health care. In P. Carayon (Ed.), Handbook of human factors and ergonomics in health care and patient safety. Boca Raton FL: CRC Press, Taylor and Francis Group.

    Google Scholar 

  • Dollard, D., Doob, L., Miller, N., Mowrer, O., & Sears, R. (1939). Frustration and aggression. New Haven, CT: Yale University Press.

    Book  Google Scholar 

  • Donald, M. (1991). The origins of the modern mind. Cambridge MA: Harvard University Press.

    Google Scholar 

  • Donald, M. (2001). A mind so rare. New York: W.W. Norton.

    Google Scholar 

  • Donald, M. (2012). Commentary on Cowley’s chapter. Interaction Studies, 13, 41–49.

    Article  Google Scholar 

  • Galosia, M., Cowley, S. J., Aliner, G., & Steffensen, S. V. (2010). When life hangs on biosemiosis: Tracking expertise in a medical simulation centre. In S. J. Cowley, J. C. Major, S. V. Steffensen, & A. Dinis (Eds.), Signifying bodies: Biosemiosis, interaction and health (pp. 173–200). Braga: Portuguese Catholic University Press.

    Google Scholar 

  • Goodwin, C. (2000). Action and embodiment within situated human interaction. Journal of Pragmatics, 32, 1489–1522.

    Article  Google Scholar 

  • Harel, I. (1991). The silent observer and holistic note taker: Using video to document a research project. In I. Harel & S. Papert (Eds.), Constructionism. Norwood, NJ: Ablex Publishers.

    Google Scholar 

  • Hemmingsen, B. (2013). The quick and the dead: On temporality and human agency. In S. J. Cowley & F. Vallée-Tourangeau (Eds.), Cognition beyond the brain: Interactivity, computation and human artifice. Dordrecht: Springer.

    Google Scholar 

  • Hodges, B. H., & Baron, R. M. (1992). Values as constraints on affordances: Perceiving and acting properly. Journal for the Theory of Social Behaviour, 22, 263–294.

    Article  Google Scholar 

  • Hollan, J., Hutchins, E., & Kirsch, D. (2000). Distributed cognition: Toward a new foundation for human–computer interaction. ACM Transactions on Human-Computer Interaction, 7, 174–196.

    Article  Google Scholar 

  • Hutchins, E. (1995a). Cognition in the wild. Cambridge, MA: MIT Press.

    Google Scholar 

  • Hutchins, E. (1995b). How a cockpit remembers its speeds. Cognitive Science, 19, 265–288.

    Article  Google Scholar 

  • Järvilehto, T. (1998). The theory of the organism-environment system: I. Description of the theory. Integrative Physiological and Behavioral Science, 33, 321–334.

    Article  Google Scholar 

  • Järvilehto, T. (2009). The theory of the organism-environment system as a basis of experimental work in psychology. Ecological Psychology, 21, 112–120.

    Article  Google Scholar 

  • Kirsh, D. (1997). Interactivity and multimedia interfaces. Instructional Sciences, 25, 79–96.

    Article  Google Scholar 

  • Kirsh, D. (2006). Distributed cognition: A methodological note. Pragmatics & Cognition, 14, 249–262.

    Article  Google Scholar 

  • Kirsh, D. (this vol.). Thinking with external representations.

    Google Scholar 

  • Linell, P. (2009). Rethinking language, mind, and world dialogically: Interactional and contextual theories of human sense-making. Charlotte, NC: Information Age Publishing.

    Google Scholar 

  • Lorenz, E. N. (1963). Deterministic nonperiodic flow. Journal of Atmospheric Sciences, 20, 130–141.

    Article  Google Scholar 

  • Maier, N. R. F. (1930). Problem solving and creativity in individuals and groups. Belmont, CA: Brooks.

    Google Scholar 

  • McGarry, B. (2005). Things to think with: Understanding interactions with artefacts in engineering design. Ph.D. Dissertation, University of Queensland, St Lucia.

    Google Scholar 

  • Pedersen, S. B. (2010). Towards dialogical health care practices: Human errors as a result of cultural affordances. In S. J. Cowley, J. C. Major, S, V. Steffensen, & A. Dinis (Eds.), Signifying bodies: Biosemiosis, interaction and health (pp. 245–276). Braga: Catholic University of Portugal.

    Google Scholar 

  • Pedersen, S. B. (2012). Interactivity in health care: Bodies, values and dynamics. Language Sciences, 34, 532–542.

    Article  Google Scholar 

  • Pedersen, S. B. (2015). The cognitive ecology of human errors in emergency medicine: An interactivity-based approach (Ph.D.). Odense: University of Southern Denmark.

    Google Scholar 

  • Perry, M. (this vol.). Socially distributed cognition in loosely coupled systems.

    Google Scholar 

  • Reed, E. S. (1996). Encountering the world: Toward an ecological psychology. Oxford: Oxford University Press.

    Google Scholar 

  • Robbins, P., & Aydede, M. (Eds.). (2009). The Cambridge handbook of situated cognition. Cambridge: Cambridge University Press.

    Google Scholar 

  • Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.

    Article  Google Scholar 

  • de Saussure, F. (1916/1972). Cours de linguistique générale. Paris: Payot.

    Google Scholar 

  • Scheerer, M. (1963). Problem solving. Scientific American, 208, 118–128.

    Article  Google Scholar 

  • Steffensen, S. V. (2009). Language, languaging and the extended mind hypothesis. Pragmatics & Cognition, 17, 677–697.

    Article  Google Scholar 

  • Steffensen, S. V. (2011). Beyond mind: An extended ecology of languaging. In S. J. Cowley (Ed.), Distributed language (pp. 185–210). Amsterdam: John Benjamins.

    Chapter  Google Scholar 

  • Steffensen, S. V. (2012). Care and conversing in dialogical systems. Language Sciences, 34, 513–531.

    Article  Google Scholar 

  • Steffensen, S. V. (2015). Distributed language and dialogism: Notes on non-locality, sense-making and interactivity. Language Sciences, 50, 105–119. doi:10.1016/j.langsci.2015.01.004.

  • Steffensen, S. V., & Cowley, S. J. (2010). Signifying bodies and health: A non-local aftermath. In S. J. Cowley, J. C. Major, S. V. Steffensen, & A. Dinis (Eds.), Signifying bodies: Biosemiosis, interaction and health (pp. 331–356). Braga: Catholic University of Portugal.

    Google Scholar 

  • Steffensen, S. V., Thibault, P. J., & Cowley, S. J. (2010). Living in the social meshwork: The case of health interaction. In S. J. Cowley, J. C. Major, S. V. Steffensen, & A. Dinis (Eds.), Signifying bodies: Biosemiosis, interaction and health (pp. 207–244). Braga: Catholic University of Portugal.

    Google Scholar 

  • Steffensen, S. V., Vallee-Tourangeau, F., & Vallee-Tourangeau, G. (2016). Cognitive events in a problem-solving task: A qualitative method for investigating interactivity in the 17 animals problem. Journal of Cognitive Psychology, 28(1), 79–105. doi:10.1080/20445911.2015.1095193

  • Thibault, P. J. (2011). First order languaging dynamics and second-order language: The distributed language view. Ecological Psychology, 23, 210–245.

    Article  Google Scholar 

  • Trevarthen, C. (1998). The concept and foundations of intersubjectivity. In S. Bråten (Ed.), Intersubjective communication and emotion in early ontogeny (pp. 15–46). Cambridge: Cambridge University Press.

    Google Scholar 

  • Weisberg, R. W., & Alba, J. W. (1981). An examination of the alleged role of “fixation” in the solution of several “insight” problems. Journal of Experimental Psychology: General, 110, 169–192.

    Article  Google Scholar 

  • Wertsch, J. (2002). Voices of collective remembering. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Wilson, R. A., & Clark, A. (2009). How to situate cognition. Letting nature take its course. In Robbins, P., & Aydede, M. (Eds.), The Cambridge handbook of situated cognition. Cambridge: Cambridge University Press.

    Google Scholar 

  • Wittgenstein, L. (1953). Philosophical investigations. Oxford: Basil Blackwell.

    MATH  Google Scholar 

Download references

Acknowledgements

I am grateful to the editors for the valuable comments and suggestions. Likewise, Sarah Bro Trasmundi (University of Southern Denmark) contributed with helpful suggestions, and Rasmus Nielsen (University of Southern Denmark) assisted in the interpretation of the spectrogram in Fig. 5.7. Finally, I am indebted to Anne-Kathrine Brorsen who allowed me to use her data for the in-depth analysis, and not least indebted to Black and White for sharing their problem-solving with us.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sune Vork Steffensen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Steffensen, S.V. (2017). Human Interactivity: Problem-Finding, Problem-Solving, and Verbal Patterns in the Wild. In: Cowley, S., Vallée-Tourangeau, F. (eds) Cognition Beyond the Brain. Springer, Cham. https://doi.org/10.1007/978-3-319-49115-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49115-8_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49114-1

  • Online ISBN: 978-3-319-49115-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics