Skip to main content

Visual Iconic Patterns of Instant Messaging: Steps Towards Understanding Visual Conversations

  • Chapter
  • First Online:
International Handbook of Internet Research
  • 5533 Accesses

Abstract

An Instant Messaging (IM) conversation is a dynamic communication register made up of text, images, animation and sound played out on a screen with potentially several parallel conversations and activities all within a physical environment. This article first examines how best to capture this unique gestalt using in situ recording techniques (video, screen capture, XML logs) which highlight the micro-phenomenal level of the exchange and the macro-social level of the interaction. Of particular interest are smileys first as cultural artifacts in CMC in general then as linguistic markers. A brief taxonomy of these markers is proposed in an attempt to clarify their frequency and patterns of their use. Then, focus is placed on their importance as perceptual cues which facilitate communication, while also serving as emotive and emphatic functional markers. We try to demonstrate that the use of smileys and animation is not arbitrary but an organized interactional and structured practice. Finally, we discuss how the study of visual markers in IM could inform the study of other visual conversation codes, such as sign languages, which also have co-produced, physical behavior, suggesting the possibility of a visual phonology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For more on situated and shared practice of language organisation, cf. Harold Garfinkel, Studies in Ethnomethodology, Englewood Cliffs, NJ, Prentice Hall, 1967.

  2. 2.

    Another article in this volume of particular interest to studying visual cues is by Marcoccia and Gauducheau (2007) dealing with the oral-written dimension of smileys in discussion groups and emails.

  3. 3.

    Cf: Baron, N. (2008). “Adjusting the Volume: Technology and Multitasking in Discourse Control”.

  4. 4.

    Each session consists of multiple conversations. In a typical scenario, the user had three to ten different conversations for each session and therefore multiple XML log files.

  5. 5.

    The duration was also influenced by the length of the video cassettes and the fact that the participants were in a cybercafé.

  6. 6.

    In the search for subjects, we discovered that IM is considered a very private activity, and many people were unwilling to participate. Other subjects curtailed some of their more intimate exchanges first by announcing to their conversation partners that they were in a study and being recorded and by avoiding embarrassing subjects that may have arisen.

  7. 7.

    In Japanese chat, ASCII smileys have a “frontal” point of view and are read vertically instead of horizontally.

  8. 8.

    In a recent survey of instant messaging, Yahoo! found that 66% of the 40,000 IM users surveyed have memorized at least 3 text-character shortcuts for using emoticons, while 19% have memorized 10 or more, cf. http://blog.messenger.yahoo.com/blog/2007/07/10/emoticon-survey-results/ (accessed 28 October 2007).

  9. 9.

    We opted against using a more “morphological” approach, in which the stem symbol is the base form of a round, yellow circle because identifying prefixes, infixes or suffixes proved more problematic, in particular, for smileys that are not based on the smiley face such as the rainbow or lips.

  10. 10.

    The long breaks described by other researchers of IM did not occur in our sample study due to the fact that the participants were connecting from a cybercafé.

  11. 11.

    Cf. Bays (2001, 2003, 2005), Bays et al. (2006).

  12. 12.

    The video and screen capture data were recorded in a Parisian cybercafé (Bays et al., 2006, Avi4. 00 :23 :10).

  13. 13.

    Figures 1 and 2, above, show video stills of our subject reacting to this same exchange of animations. Likewise, she points at the screen selecting, laughs and then types her reply.

References

  • Anis, J. (1988). L‘écriture, théories et descriptions. Bruxelles: De Boeck-Université.

    Google Scholar 

  • Anis, J. (1998). Texte et ordinateur: l’écriture réinventée. Bruxelles: De Boeck Université.

    Google Scholar 

  • Anis, J. (1999). Internet communication et langue francaise. Paris: Hermes Science Publications.

    Google Scholar 

  • Auer, P., Cooper-Kuhlen, E., Müller, F. (1999). Language in time, the rhythm and tempo of spoken interaction. Oxford: Oxford University Press.

    Google Scholar 

  • Baron, N. (2003). Language of the internet. In A. Farghali (Ed.), The Stanford handbook for language engineers (pp. 59–127). Stanford, CA: CSLI Publications.

    Google Scholar 

  • Baron, N. (2005a, February 17–21). Instant messaging by American college students: A case study in computer mediated communication. American Association for the Advancement of Science annual meeting.

    Google Scholar 

  • Baron, N. (2005b). Tethered or mobile? Use of away messages in instant messaging by American college students (with Lauren Squires, Sara Tench, and Marshall Thompson). In R. Ling & P. Pederson (Eds.) Mobile communications: Re-negotiation of the social sphere (pp. 293–311). London: Springer-Verlag.

    Google Scholar 

  • Baron, N. (2005c). Instant messaging and the future of language. Communications of the ACM, 48(7), 29–31.

    Article  Google Scholar 

  • Baron, N. (2007). The mechanics of text messaging and instant messaging among American college students (with Rich Ling). Journal of Language and Social Psychology, 26, 291–298.

    Article  MathSciNet  Google Scholar 

  • Baron, N. (2008). Adjusting the volume: Technology and multitasking in discourse control. In J. E. Katz (Ed.), Handbook of mobile communication studies (pp. 177–193). Cambridge, MA: MIT Press.

    Google Scholar 

  • Bays, H. (2001). Interaction conversationnelle en internet relay chat. Doctoral dissertation in Linguistics, directed by Professeur Pierre Encreve at the Ecole des Hautes Etudes en Sciences Sociales, Paris, defended 21 décembre 2001.

    Google Scholar 

  • Bays, H. (2003, March). Temporalité en internet relay chat: Le rythme du discours électronique. Communication électronique, conference at the Ecole des Hautes Etudes en Sciences Sociales, Paris.

    Google Scholar 

  • Bays, H. (2005, October 6–9). Visio-verbal constructions of rhythm in IM & IRC: A cross-linguistic study. Internet research 6.0: Generations, Proceedings of the 6th Annual Conference of the Association of Internet Researchers, Chicago, IL, USA.

    Google Scholar 

  • Bays, H., de Fornel, M., & Verdier, M. (2006). Rythmes et temporalités de la conversation Electronique (RYTE). Research report for the CNRS program PI-TCAN.

    Google Scholar 

  • Blum, S. (2004). Instant messaging: Functions of a new communicative tool. Anthropology 427: Doing things with words.

    Google Scholar 

  • Bunn, J. (2002). Wave forms: A natural syntax for rhythmic language. Palo Alto, CA: Stanford University Press.

    Google Scholar 

  • Chen, L., & Gaines, B. (1998). Modeling and supporting virtual cooperative interaction through the world wide web. In F. Sudweeks, M. McLaughlin, & S. Rafaeli (Eds.), Network and netplay, virtual groups on the internet (pp. 221–242). Cambridge, MA: MIT Press.

    Google Scholar 

  • Cuxac, C. (2000). La LSF, les voies de l’iconicité. Paris: Ophrys.

    Google Scholar 

  • Cuxac, C., Fusellier-Souza, I., & Sallandre, M.-A. (1999). Iconicité et catégorisations dans les langues des signes. Sémiotiques, 16, 143–166.

    Google Scholar 

  • Danet, B. (2001). Cyberpl@y: Communicating online. Oxford: Berg Publishers. Companion web site, URL http://pluto.mscc.huji.ac.il/~msdanet/cyberpl@y/

  • Delalande, M.-A. (2007). La messagerie instantanée freine la productivité des enterprises. Le Monde Informatique, Edition du 12/10/2007.

    Google Scholar 

  • Derks, D., Bos, A. E. R., & Von Grumkow, J. (2007). Emoticons and social interaction on the internet: The importance of social context. Computers in Human Behavior, 23, 842–849.

    Article  Google Scholar 

  • Farmer, R. (2003). Instant messaging – Collaborative tool or educator’s nightmare! NA Web 2003, http://www.unb.ca/naweb/proceedings/2003/PaperFarmer.html [29 October 2007].

  • Finn, A. (1999). Temporality and technology convergence. Information, Communication & Society, 2(2), 174–200.

    MathSciNet  Google Scholar 

  • Gross, E. F. (2004). Adolescent internet use: What we expect, what teens report. Applied Developmental Psychology, 25, 633–649.

    Article  Google Scholar 

  • Haiman, J. (1985). Natural syntax: Iconicity and erosion. Cambridge: Cambridge University Press.

    Google Scholar 

  • Herring, S., (Ed.). (1996). Computer-mediated communication: Linguistic, social and cross-cultural perspectives. Pragmatics and Beyond series. Amsterdam: John Benjamins.

    Google Scholar 

  • Kharif, O. (2001, April 23). The man who brought a :-) to your dcreen. Business Week Online. Retrieved from http://www.businessweek.com/bwdaily/dnflash/apr2001/nf20010423_785.htm [29 October 2007].

  • Lenhart, A., Rainie, L., & Lewis, O. (2001). Teenage life online: The rise of the instant-message generation and the internet’s impact on friendships and family relationships. Retrieved from http://www.pewinternet.org/pdfs/PIP_Teens_Report.pdf [29 October 2007].

  • Marcoccia, M., & Gauducheau, N. (2007). L’analyse du rôle des smileys en production et en réception: Un retour sur la question de l’oralité des écrits numériques. In I. Pierozak (Ed.), Glottopol, revue sociologique en ligne. Retrieved from http://www.univ-rouen.fr/dyalang/glottopol/numero_10.html#sommaire [29 October 2007].

  • Metzger, M. (2001). Discourse analysis. In C. Lucas (Ed.), The sociolinguistics of sign languages (pp. 112–144). Cambridge: Cambridge University Press.

    Google Scholar 

  • Milford, M. (2007, September 17). It began with smiley. Delaware Online. Retrieved from http://delawareonline.com/apps/pbcs.dll/article?AID=/20070917/BUSINESS/70917002/1003 [29 October 2007].

  • O’Connor, A. (2006). Instant messaging: Friend or foe of student writing? New Horizons for Learning, March 2005 Retrieved from http://www.newhorizons.org/strategies/literacy/oconnor.htm [29 October 2007].

  • Pierozak, I. (Ed.). (2007, July). Regards sur l’internet, dans ses dimensions langagières. Penser les continuités et discontinuities En hommage à Jacques Anis. Glottopol: revue sociologique en ligne (10). Retrieved from http://www.univ-rouen.fr/dyalang/glottopol/numero_10.html [29 October 2007].

  • Pinolosacco, G. (2007, January). La sociologie visuelle. Sociétés.

    Google Scholar 

  • Quan-Hasse, A., Cothrel, J., & Wellman, B. (2005). Instant messaging for collaboration: A case study of a high-tech firm. Journal of Computer-Mediated Communication, 10(4), article 13. Retrieved from http://jcmc.indiana.edu/vol10/issue4/quan-haase.html

  • Randall, N. (2002). Lingo online: A report on the language of the keyboard generation. California: MSN publications. Retrieved from http://arts.uwaterloo.ca/~nrandall/LingoOnline-finalreport.pdf [29 October 2007].

  • Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.

    Article  Google Scholar 

  • Schieffelin, B., & Jones, G. (2008). Enquoting voices, accomplishing talk: Uses of be + like in instant messaging. Language & Communication, 29(1), 77–113.

    Google Scholar 

  • Shiu, E., & Lenhart, A. (2004). How Americans use instant messaging. Washington, DC: Pew Internet and American Life Project. Retrieved from http://www.pewinternet.org [October 29, 2007].

  • Stephenson, N. (1993, September 13). Smiley’s people. The New Republic, 52. Retrieved from http://www.spesh.com/lee/ns/smiley.html

  • Stevenson, J. (1999). The language of internet chat rooms. Language Data Investigation . Retrieved from http://www.demo.inty.net/Units/IRC.htm [29 October 2007].

  • Tagliamonte, S., & Denis, D. (2006, Aug 2). OMG, will txting and IM lead 2 bad grammar? Linguistics Society of Canada and the United States annual meeting.

    Google Scholar 

  • Walther, J. B., & D’Addario, K. P. (2001). The impact of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324–347.

    Article  Google Scholar 

  • Wellman, B. (2001). Computer networks as social networks. Science, 293, 2031–2034.

    Article  Google Scholar 

  • Wellman, B. (2007). Emoticons panel interview on The Current, Canadian Broadcasting Corporation. Retrieved from http://www.cbc.ca/thecurrent/2007/200709/20070926.html [29 October 2007].

  • Yahoo! Emoticon Survey Results (2007, July 10). Retrieved from http://blog.messenger.yahoo.com/blog/2007/07/10/emoticon-survey-results/ [29 October 2007].

  • Yates, S. J. (1996). Oral and written linguistic aspects of computer conferencing: A corpus based study. In S. C. Herring (Ed.), Computer-mediated communication. linguistic, social and cross-cultural perspectives (pp. 29–46). Amsterdam/Philadelphia: John Benjamins.

    Google Scholar 

  • Yechi, L. (1996). The geometry of visual phonology. Stanford, CA: Center for the Study of Language and Information (CSLI) Publications.

    Google Scholar 

Download references

Acknowledgments

The corpus used for this article was made possible by a grant from the French CNRS for the previous research project on Rhythm and Temporalities of Electronic Communication by Michel de Fornel, Maud Verdier and Hillary Bays. Special thanks go to Maud Verdier who diligently worked collecting a good portion of the data and on assembling the final report, to Michel de Fornel for some insight on recording electronic conversation using methods generally reserved for interaction studies and to Mickaëlle Lantin for digitalizing and organizing the video data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hillary Bays .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media B.V.

About this chapter

Cite this chapter

Bays, H. (2009). Visual Iconic Patterns of Instant Messaging: Steps Towards Understanding Visual Conversations. In: Hunsinger, J., Klastrup, L., Allen, M. (eds) International Handbook of Internet Research. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-9789-8_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4020-9789-8_3

  • Published:

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-9788-1

  • Online ISBN: 978-1-4020-9789-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics