What Data Measures Are Used in Study Abroad Research?
This chapter begins with a general overview of the different data types that are seen in study abroad research, discussing the differences between elicited and natural language use (comprehension and production) data, data from metalinguistic judgments, and self-report data. What follows is a description of the research measures needed to gather data that is required to investigate study abroad gains. The perspective adopted is that all measures have relative advantages and disadvantages that often complement one another, so converging evidence of more than one kind can reasonably be sought. The chapter concludes with an overall summary as well as questions for reflection and suggestions for further reading.
KeywordsElicited language use Metalinguistic judgements Free production
- Benatti, A. (2015). Proficiency. In P. Robinson (Ed.), The Routledge encyclopedia of second language acquisition (pp. 520–523). New York: Routledge.Google Scholar
- Canale, M. (1983). From communicative competence to communicative language pedagogy. In J. C. Richards & R. W. Schmidt (Eds.), Language and communication (pp. 2–27). New York: Longman.Google Scholar
- CEFR. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge, UK: Cambridge University Press. https://www.coe.int/en/web/common-european-frameworkreference-languages/table-1-cefr-3.3-common-reference-levels-global-scale. Accessed 3 June 2019.
- Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.Google Scholar
- Cohen, A. D., & Shively, R. L. (2002/2003). Measuring speech acts with multiple rejoinder DCTs. Language Testing Update, 32, 39–42.Google Scholar
- Collentine, J. (2004). The effects of learning contexts on morphosyntactic and lexical development. Studies in Second Language Acquisition, 26(2), 227–248.Google Scholar
- Collentine, J., & Freed, B. (2004). Learning context and its effects on second language acquisition. Introduction. Studies in Second Language Acquisition, 26(2), 153–171.Google Scholar
- Creswell, J. W. (2003). Research design: Qualitative, quantitative, and mixed methods approaches (2nd ed.). Thousand Oaks, CA: Sage Publications.Google Scholar
- DeKeyser, R. (1991). Foreign language development during a semester abroad. In B. Freed (Ed.), Foreign language acquisition research and the classroom (pp. 104–119). Lexington, MA: D.C. Heath.Google Scholar
- DeKeyser, R. (2014). Research on language development during study abroad: Methodological considerations and future perspectives. In C. Pérez-Vidal (Ed.), Language acquisition in study abroad and formal instruction contexts (pp. 313–326). Philadelphia: John Benjamins.Google Scholar
- Dewey, D. P. (2002). The effects of study context on the acquisition of reading by students of Japanese as a second language: A comparison of study-abroad and intensive domestic immersion. Unpublished doctoral dissertation, Carnegie Mellon University, Pittsburgh, PA.Google Scholar
- Dewey, D. P. (2008). Japanese vocabulary acquisition by learners in three contexts. Frontiers: The Interdisciplinary Journal of Study Abroad, 15, 127–148.Google Scholar
- Díaz-Campos, M. (2006). The effect of style in second language phonology: An analysis of segmental acquisition in study abroad and regular-classroom students. In C. A. Klee & T. L. Face (Eds.), Selected proceedings of the 7th conference on the acquisition of Spanish and Portuguese as first and second languages (pp. 26–39). Sommerville, MA: Cascadilla Proceedings Project.Google Scholar
- Duchastel, J., & Laberge, D. (2014). Beyond the quantitative and qualitative cleavage: Confluence of research operations in discourse analysis. In R. Scholz (Ed.), Quantifying approaches to discourse for social scientists: Postdisciplinary studies in discourse (pp. 23–47). New York: Palgrave Macmillan.Google Scholar
- Eurocenter Free Language Test. (n.d.). https://www.eurocentres.com/en/free-language-test. Accessed 3 June 2019.
- Félix-Brasdefer, J. C. (2010). Data collection methods in speech act performances: DCTS, role plays, and verbal reports. In A. Martínez-Flor & E. Usó-Juan (Eds.), Speech act performance: Theoretical, empirical and methodological issues (pp. 41–56). Philadelphia: John Benjamins.CrossRefGoogle Scholar
- Freed, B., Dewey, D., Segalowitz, N., & Halter, R. (2005). The language contact profile. Studies in Second Language Acquisition, 26, 349–356.Google Scholar
- Freed, B., So, S., & Lazar, N. (2003). Language learning abroad: How do gains in written fluency compare with gains in oral fluency in French as a second language? ADFL Bulletin, 34(3), 34–40.Google Scholar
- Harlow, B. (2015). Taking out the guesswork: Using research to build arts audiences. In J. Gill (Ed.), Wallace studies in building arts audiences. New York: Bob Harlow Research and Consulting, LLC. https://www.wallacefoundation.org/knowledge-center/Documents/Taking-Out-the-Guesswork.pdf. Accessed 3 June 2019.Google Scholar
- Harris, Z. S., & Voegelin, C. F. (1953). Eliciting in linguistics. Southwestern Journal of Anthropology, 9(1), 59–75. https://www.jstor.org/stable/3628494?seq=1#metadata_info_tab_contents. Accessed 3 June 2019.CrossRefGoogle Scholar
- Hodkinson, P., & Hodkinson, H. (2001, December). The strengths and limitations of case study research. Paper presented to the Learning and skills development agency conference: Making an impact on policy and practice, Cambridge, UK. http://education.exeter.ac.uk/tlc/docs/publications/LE_PH_PUB_05.12.01.rtf.26.01.2013. Accessed 3 June 2019.
- Jackson, J. (2008). Language, identity and study abroad: Sociolinguistic perspectives. New York: Palgrave Macmillan.Google Scholar
- Johnstone, B. (2018). Discourse analysis (3rd ed.). Hoboken, NJ: John Wiley & Sons.Google Scholar
- Kasper, G., & Roever, C. (2005). Pragmatics in second language learning. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 317–334). New York: Routledge.Google Scholar
- Kyle, K., Crossley, S., Berger, C., Bradfield, F., Dascalu, M., Kim, M., & McNamara, D. (n.d.). NLP tools for the social sciences. https://www.linguisticanalysistools.org/bios.html. Accessed 3 June 2019.
- Linford, B. (2016). The second-language development of dialect-specific morpho-syntactic variation in Spanish during study abroad. Unpublished doctoral dissertation, Indiana University, Bloomington, IN.Google Scholar
- Saussure, F. (1986). Course in general linguistics (3rd ed.). Chicago: Open Court Publishing.Google Scholar
- Savignon, S. J. (2017). Communicative competence: Teaching grammar. In J. I. Liontas (Ed.), The TESOL encyclopedia of english language teaching (pp. 1–7). Hoboken, NJ: John Wiley.Google Scholar
- Segalowitz, N., Freed, B., Collentine, J., Lafford, B., Lazar, N., & Díaz-Campos, M. (2004). A comparison of Spanish second language acquisition in two different learning contexts: Study abroad and the domestic classrooms. Frontiers: The Interdisciplinary Journal of Study Abroad, 10, 1–18.Google Scholar
- Stevens, J. J. (2001). Study abroad learners’ acquisition of Spanish voiceless stops. MIFLC Review, 10, 137–151.Google Scholar
- Tan, B. H., & Nor Izzati, M. N. (2015). Grammaticality judgement test: Do item formats affect test performance? Social Sciences & Humanities, 23(S), 119–130.Google Scholar
- van Lier, L. (1988). The classroom and the language learner: Ethnography and second-language classroom research. London: Longman.Google Scholar
- Young, R. (2015). Qualitative research. In P. Robinson (Ed.), The Routledge encyclopedia of second language acquisition (pp. 536–539). New York: Routledge.Google Scholar
Suggestions for Further Reading
- AAAL guidelines for publishing in applied linguistics. (n.d.). https://www.aaal.org/guidelines-for-publishing-in-applied-linguistics##. Accessed 3 June 2019.
- APA Publications Manual (6th ed). (2010). Washington, DC: APA.Google Scholar
- Gudmestad, A., & Edmonds, A. (Eds.). (2018). Critical reflections on data in second language acquisition. Philadelphia: John Benjamins.Google Scholar
- Hall, C. J., Smith, P. H., & Wicaksono, R. (2011). Mapping applied linguistics: A guide for students and practitioners. New York: Routledge.Google Scholar
- Hatch, E., & Lazaraton, A. (1991). The research manual: Design and statistics for applied linguistics. Boston, MA: Heinle & Heinle Publishers.Google Scholar
- Light, R., & Pillemer, D. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.Google Scholar
- Litosseliti, L. (2018). Research methods in linguistics (2nd ed.). London: Bloomsbury Academic.Google Scholar
- Mackey, A., & Gass, S. M. (2005). Second language research: Methodology and design. Mahwah, NJ: Erlbaum.Google Scholar
- Martínez-Flor, A., & Usó-Juan, E. (2011). Research methodologies in pragmatics: Eliciting refusals to requests. Estudios de Lingüística Inglesa Aplicada, 11, 47–87. https://www.ufrgs.br/ppgletras/2017selecao/ATT00243.pdf. Accessed 3 June 2019.Google Scholar
- Merriam, S. B., & Grenier, R. S. (2019). Qualitative research in practice: Examples for discussion and analysis (2nd ed.). San Francisco: Jossey-Bass, A Wiley Brand.Google Scholar
- Paltridge, B., & Phakiti, A. (2015). Research methods in applied linguistics: A practical resource. London: Bloomsbury.Google Scholar