Abstract
An Instant Messaging (IM) conversation is a dynamic communication register made up of text, images, animation and sound played out on a screen with potentially several parallel conversations and activities all within a physical environment. This article first examines how best to capture this unique gestalt using in situ recording techniques (video, screen capture, XML logs) which highlight the micro-phenomenal level of the exchange and the macro-social level of the interaction. Of particular interest are smileys first as cultural artifacts in CMC in general then as linguistic markers. A brief taxonomy of these markers is proposed in an attempt to clarify their frequency and patterns of their use. Then, focus is placed on their importance as perceptual cues which facilitate communication, while also serving as emotive and emphatic functional markers. We try to demonstrate that the use of smileys and animation is not arbitrary but an organized interactional and structured practice. Finally, we discuss how the study of visual markers in IM could inform the study of other visual conversation codes, such as sign languages, which also have co-produced, physical behavior, suggesting the possibility of a visual phonology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
For more on situated and shared practice of language organisation, cf. Harold Garfinkel, Studies in Ethnomethodology, Englewood Cliffs, NJ, Prentice Hall, 1967.
- 2.
Another article in this volume of particular interest to studying visual cues is by Marcoccia and Gauducheau (2007) dealing with the oral-written dimension of smileys in discussion groups and emails.
- 3.
Cf: Baron, N. (2008). “Adjusting the Volume: Technology and Multitasking in Discourse Control”.
- 4.
Each session consists of multiple conversations. In a typical scenario, the user had three to ten different conversations for each session and therefore multiple XML log files.
- 5.
The duration was also influenced by the length of the video cassettes and the fact that the participants were in a cybercafé.
- 6.
In the search for subjects, we discovered that IM is considered a very private activity, and many people were unwilling to participate. Other subjects curtailed some of their more intimate exchanges first by announcing to their conversation partners that they were in a study and being recorded and by avoiding embarrassing subjects that may have arisen.
- 7.
In Japanese chat, ASCII smileys have a “frontal” point of view and are read vertically instead of horizontally.
- 8.
In a recent survey of instant messaging, Yahoo! found that 66% of the 40,000 IM users surveyed have memorized at least 3 text-character shortcuts for using emoticons, while 19% have memorized 10 or more, cf. http://blog.messenger.yahoo.com/blog/2007/07/10/emoticon-survey-results/ (accessed 28 October 2007).
- 9.
We opted against using a more “morphological” approach, in which the stem symbol is the base form of a round, yellow circle because identifying prefixes, infixes or suffixes proved more problematic, in particular, for smileys that are not based on the smiley face such as the rainbow or lips.
- 10.
The long breaks described by other researchers of IM did not occur in our sample study due to the fact that the participants were connecting from a cybercafé.
- 11.
- 12.
The video and screen capture data were recorded in a Parisian cybercafé (Bays et al., 2006, Avi4. 00 :23 :10).
- 13.
References
Anis, J. (1988). L‘écriture, théories et descriptions. Bruxelles: De Boeck-Université.
Anis, J. (1998). Texte et ordinateur: l’écriture réinventée. Bruxelles: De Boeck Université.
Anis, J. (1999). Internet communication et langue francaise. Paris: Hermes Science Publications.
Auer, P., Cooper-Kuhlen, E., Müller, F. (1999). Language in time, the rhythm and tempo of spoken interaction. Oxford: Oxford University Press.
Baron, N. (2003). Language of the internet. In A. Farghali (Ed.), The Stanford handbook for language engineers (pp. 59–127). Stanford, CA: CSLI Publications.
Baron, N. (2005a, February 17–21). Instant messaging by American college students: A case study in computer mediated communication. American Association for the Advancement of Science annual meeting.
Baron, N. (2005b). Tethered or mobile? Use of away messages in instant messaging by American college students (with Lauren Squires, Sara Tench, and Marshall Thompson). In R. Ling & P. Pederson (Eds.) Mobile communications: Re-negotiation of the social sphere (pp. 293–311). London: Springer-Verlag.
Baron, N. (2005c). Instant messaging and the future of language. Communications of the ACM, 48(7), 29–31.
Baron, N. (2007). The mechanics of text messaging and instant messaging among American college students (with Rich Ling). Journal of Language and Social Psychology, 26, 291–298.
Baron, N. (2008). Adjusting the volume: Technology and multitasking in discourse control. In J. E. Katz (Ed.), Handbook of mobile communication studies (pp. 177–193). Cambridge, MA: MIT Press.
Bays, H. (2001). Interaction conversationnelle en internet relay chat. Doctoral dissertation in Linguistics, directed by Professeur Pierre Encreve at the Ecole des Hautes Etudes en Sciences Sociales, Paris, defended 21 décembre 2001.
Bays, H. (2003, March). Temporalité en internet relay chat: Le rythme du discours électronique. Communication électronique, conference at the Ecole des Hautes Etudes en Sciences Sociales, Paris.
Bays, H. (2005, October 6–9). Visio-verbal constructions of rhythm in IM & IRC: A cross-linguistic study. Internet research 6.0: Generations, Proceedings of the 6th Annual Conference of the Association of Internet Researchers, Chicago, IL, USA.
Bays, H., de Fornel, M., & Verdier, M. (2006). Rythmes et temporalités de la conversation Electronique (RYTE). Research report for the CNRS program PI-TCAN.
Blum, S. (2004). Instant messaging: Functions of a new communicative tool. Anthropology 427: Doing things with words.
Bunn, J. (2002). Wave forms: A natural syntax for rhythmic language. Palo Alto, CA: Stanford University Press.
Chen, L., & Gaines, B. (1998). Modeling and supporting virtual cooperative interaction through the world wide web. In F. Sudweeks, M. McLaughlin, & S. Rafaeli (Eds.), Network and netplay, virtual groups on the internet (pp. 221–242). Cambridge, MA: MIT Press.
Cuxac, C. (2000). La LSF, les voies de l’iconicité. Paris: Ophrys.
Cuxac, C., Fusellier-Souza, I., & Sallandre, M.-A. (1999). Iconicité et catégorisations dans les langues des signes. Sémiotiques, 16, 143–166.
Danet, B. (2001). Cyberpl@y: Communicating online. Oxford: Berg Publishers. Companion web site, URL http://pluto.mscc.huji.ac.il/~msdanet/cyberpl@y/
Delalande, M.-A. (2007). La messagerie instantanée freine la productivité des enterprises. Le Monde Informatique, Edition du 12/10/2007.
Derks, D., Bos, A. E. R., & Von Grumkow, J. (2007). Emoticons and social interaction on the internet: The importance of social context. Computers in Human Behavior, 23, 842–849.
Farmer, R. (2003). Instant messaging – Collaborative tool or educator’s nightmare! NA Web 2003, http://www.unb.ca/naweb/proceedings/2003/PaperFarmer.html [29 October 2007].
Finn, A. (1999). Temporality and technology convergence. Information, Communication & Society, 2(2), 174–200.
Gross, E. F. (2004). Adolescent internet use: What we expect, what teens report. Applied Developmental Psychology, 25, 633–649.
Haiman, J. (1985). Natural syntax: Iconicity and erosion. Cambridge: Cambridge University Press.
Herring, S., (Ed.). (1996). Computer-mediated communication: Linguistic, social and cross-cultural perspectives. Pragmatics and Beyond series. Amsterdam: John Benjamins.
Kharif, O. (2001, April 23). The man who brought a :-) to your dcreen. Business Week Online. Retrieved from http://www.businessweek.com/bwdaily/dnflash/apr2001/nf20010423_785.htm [29 October 2007].
Lenhart, A., Rainie, L., & Lewis, O. (2001). Teenage life online: The rise of the instant-message generation and the internet’s impact on friendships and family relationships. Retrieved from http://www.pewinternet.org/pdfs/PIP_Teens_Report.pdf [29 October 2007].
Marcoccia, M., & Gauducheau, N. (2007). L’analyse du rôle des smileys en production et en réception: Un retour sur la question de l’oralité des écrits numériques. In I. Pierozak (Ed.), Glottopol, revue sociologique en ligne. Retrieved from http://www.univ-rouen.fr/dyalang/glottopol/numero_10.html#sommaire [29 October 2007].
Metzger, M. (2001). Discourse analysis. In C. Lucas (Ed.), The sociolinguistics of sign languages (pp. 112–144). Cambridge: Cambridge University Press.
Milford, M. (2007, September 17). It began with smiley. Delaware Online. Retrieved from http://delawareonline.com/apps/pbcs.dll/article?AID=/20070917/BUSINESS/70917002/1003 [29 October 2007].
O’Connor, A. (2006). Instant messaging: Friend or foe of student writing? New Horizons for Learning, March 2005 Retrieved from http://www.newhorizons.org/strategies/literacy/oconnor.htm [29 October 2007].
Pierozak, I. (Ed.). (2007, July). Regards sur l’internet, dans ses dimensions langagières. Penser les continuités et discontinuities En hommage à Jacques Anis. Glottopol: revue sociologique en ligne (10). Retrieved from http://www.univ-rouen.fr/dyalang/glottopol/numero_10.html [29 October 2007].
Pinolosacco, G. (2007, January). La sociologie visuelle. Sociétés.
Quan-Hasse, A., Cothrel, J., & Wellman, B. (2005). Instant messaging for collaboration: A case study of a high-tech firm. Journal of Computer-Mediated Communication, 10(4), article 13. Retrieved from http://jcmc.indiana.edu/vol10/issue4/quan-haase.html
Randall, N. (2002). Lingo online: A report on the language of the keyboard generation. California: MSN publications. Retrieved from http://arts.uwaterloo.ca/~nrandall/LingoOnline-finalreport.pdf [29 October 2007].
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.
Schieffelin, B., & Jones, G. (2008). Enquoting voices, accomplishing talk: Uses of be + like in instant messaging. Language & Communication, 29(1), 77–113.
Shiu, E., & Lenhart, A. (2004). How Americans use instant messaging. Washington, DC: Pew Internet and American Life Project. Retrieved from http://www.pewinternet.org [October 29, 2007].
Stephenson, N. (1993, September 13). Smiley’s people. The New Republic, 52. Retrieved from http://www.spesh.com/lee/ns/smiley.html
Stevenson, J. (1999). The language of internet chat rooms. Language Data Investigation . Retrieved from http://www.demo.inty.net/Units/IRC.htm [29 October 2007].
Tagliamonte, S., & Denis, D. (2006, Aug 2). OMG, will txting and IM lead 2 bad grammar? Linguistics Society of Canada and the United States annual meeting.
Walther, J. B., & D’Addario, K. P. (2001). The impact of emoticons on message interpretation in computer-mediated communication. Social Science Computer Review, 19(3), 324–347.
Wellman, B. (2001). Computer networks as social networks. Science, 293, 2031–2034.
Wellman, B. (2007). Emoticons panel interview on The Current, Canadian Broadcasting Corporation. Retrieved from http://www.cbc.ca/thecurrent/2007/200709/20070926.html [29 October 2007].
Yahoo! Emoticon Survey Results (2007, July 10). Retrieved from http://blog.messenger.yahoo.com/blog/2007/07/10/emoticon-survey-results/ [29 October 2007].
Yates, S. J. (1996). Oral and written linguistic aspects of computer conferencing: A corpus based study. In S. C. Herring (Ed.), Computer-mediated communication. linguistic, social and cross-cultural perspectives (pp. 29–46). Amsterdam/Philadelphia: John Benjamins.
Yechi, L. (1996). The geometry of visual phonology. Stanford, CA: Center for the Study of Language and Information (CSLI) Publications.
Acknowledgments
The corpus used for this article was made possible by a grant from the French CNRS for the previous research project on Rhythm and Temporalities of Electronic Communication by Michel de Fornel, Maud Verdier and Hillary Bays. Special thanks go to Maud Verdier who diligently worked collecting a good portion of the data and on assembling the final report, to Michel de Fornel for some insight on recording electronic conversation using methods generally reserved for interaction studies and to Mickaëlle Lantin for digitalizing and organizing the video data.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer Science+Business Media B.V.
About this chapter
Cite this chapter
Bays, H. (2009). Visual Iconic Patterns of Instant Messaging: Steps Towards Understanding Visual Conversations. In: Hunsinger, J., Klastrup, L., Allen, M. (eds) International Handbook of Internet Research. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-9789-8_3
Download citation
DOI: https://doi.org/10.1007/978-1-4020-9789-8_3
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-9788-1
Online ISBN: 978-1-4020-9789-8
eBook Packages: Computer ScienceComputer Science (R0)