Abstract
Reliability of tests can vary depending on various linguistic features. One of them is readability, which has received little academic and research interest in Russian linguistics. Following Coh-Metrix, syntax characteristics are among its elements. We compiled a corpus of texts for reading of Unified State Exam, an official tool for assessing graduates for entering Universities. The test is reliable and valid for its purposes, but it is important to study the quality of the input texts by the reference to the stated CEFR A2+, B1 and B2 levels. Conducting the research on syntactic simplicity, the paper studies the distinctive features showing the discrimination factors defining their CEFR level in order to increase the transparency of tools for choosing the texts for better task taking procedures.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Borisova, S., Chmykh, I., Gvozdeva, M., Kalinina, A., Kozhevnikova, L., Kuznetsova, O., … Solnyshkina, M. (2014). Course handbook for promoting sustainable excellence in English testing and assessment. Moscow.
Dowell, N., Cai, Z., & Graesser, A. C. (2014). Analyzing language and discourse with Coh-Metrix: Workshop presented at 2nd Learning Analytics Summer Institutes (LASI 2014). Cambridge, MA.
DuBay, W. H. (2004). The principles of readability. Costa Mesa: Impact Information.
EGE po inostrannomu iazyku stanet obiazatel’nym v 2022 godu (in Russian). (2017). Kommersant. Retrieved from https://www.kommersant.ru/doc/3311673.
Elfenbein, A. (2011). Research in text and the uses of Coh-Metrix. Educational Researcher, 40(5), 246–248. Retrieved from http://doi.org/10.3102/0013189X11414181.
Federal’nyi zakon № 17-FZ ot 09.02.2007 o vvedenii EGE (in Russian). (2007). Retrieved from http://www.consultant.ru/document/cons_doc_LAW_66070/.
Feng, L. (2011). A short analysis of the text variables affecting reading and testing reading. Studies in Literature and Language, 2(2), 44–49.
Gabdrakhmanova, R. R., Varlamova, E. V., & Safonkina, O. S. (2018). Syntactic complexity of texts for reading of basic (Russian) state examination in English. Modern Journal of Language Teaching Methods (MJLTM), 8, 367–372.
Keenan, J. M., Betjemann, R. S., & Olson, R. K. (2008). Reading comprehension tests vary in the skills they assess: Differential dependence on decoding and oral comprehension. Scientific Studies of Reading, 12(3), 281–300. https://doi.org/10.1080/10888430802132279.
Kohl, J. R. (1999). Technical communication. Journal of the Society for Technical Communication, 46(2), 149–166.
McNamara, D. S. (2014). Automated evaluation of text and discourse with Coh-Metrix. Cambridge: Cambridge University Press.
McNamara, D. S., Louwerse, M. M., McCarthy, P. M., & Graesser, A. C. (2010). Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes, 47(4), 292–330.
Oborneva, I. V. (2006). Avtomatizirovannaya otsenka slozhnosti uchebnykh tekstov na osnove statisticheskikh parametrov (in Russian). Moscow.
Prikaz Minobrnauki № 2451 ot 11.10.2011 «Ob utverzhdenii poriadka provedeniia Edinogo gosudarstvennogo ekzamena» (in Russian). (2011). Retrieved from http://www.obrnadzor.gov.ru/common/upload/doc_list/Prikaz_N_1400_ot_26.12.2013_g_Poryadok_provedeniya_GIA-11.pdf.
Safonkina, O. S. (2011). EGE-2010: rabota nad oshibkami. Obuchenie, testirovanie i otsenka, 72–75.
Safonkina, O. S. (2012). Edinyi gosudarstvennyi ekzamen v kontekste obshcheevropeiskikh kompetentsii vladeniia inostrannym iazykom. Inostrannye iazyki v usloviiakh globalizatsii: obrazovanie, ekonomika, kul’tura, 104–105.
Solnyshkina, M. I., Harkova, E. V., & Kiselnikov, A. S. (2014). Unified (Russian) State Exam in English: Reading comprehension tasks. English Language Teaching, 7, 1–11.
Solnyshkina, M. I., &Kiselnikov, A. S. (2015). Parametry slozhnosti ekzamenatsionnykh tekstov (in Russian). Vestnik Volgogradskogo gosudarstvennogo universiteta, 99–107.
Spetsifikatsiia kontrol’nykh izmeritel’nykh materialov dlia provedeniia v 2018 godu osnovnogo gosudarstvennogo ekzamena po INOSTRANNOMU IAZYKU (in Russian). (2018). Retrieved from http://fipi.ru/oge-i-gve-9/demoversii-specifikacii-kodifikatory.
Spetsifikatsiia kontrol’nykh izmeritel’nykh materialov dlia provedeniia v 2019 godu edinogo gosudarstvennogo ekzamena po INOSTRANNYM IAZYKAM (in Russian). (2019). Retrieved from http://fipi.ru/oge-i-gve-9/demoversii-specifikacii-kodifikatoryhttp://fipi.ru/ege-i-gve-11/demoversii-specifikacii-kodifikatory.
Tokenization. (2008). Cambridge University Press. Retrieved from https://nlp.stanford.edu/IR-book/html/htmledition/tokenization-1.html.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 The Author(s)
About this chapter
Cite this chapter
Varlamova, E., Safonkina, O. (2020). Readability of Syntactic Constructions for Transparency and Reliability of Input Texts for Unified State Exams in English. In: Hidri, S. (eds) Changing Language Assessment. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-42269-1_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-42269-1_8
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-030-42268-4
Online ISBN: 978-3-030-42269-1
eBook Packages: Social SciencesSocial Sciences (R0)