Abstract
This study proposes an index for measuring the ease and accuracy of pronunciation that is derived by combining the ease and the accuracy of learners’ pronunciation, assesses the reliability and validity of the combined index, and develops a measurement method. The ease is a scale score for the ease of pronunciation that learners subjectively judged, and the accuracy demonstrates learners’ pronunciation performance. A previous study proposed an index regarding ease of pronunciation, and other previous studies independently proposed indices related to accuracy. These two types of indices should be combined because they have different aspects and compensate for each other. To develop the proposed measurement method, a learner corpus of pronunciation is compiled, and index reliability and validity are assessed using the classical test theory. The assessments demonstrate that the proposed index is moderately reliable and not valid. The proposed measurement method is developed using multiple linear regression analysis. The dependent variable is an index consisting of both pronunciation ease, which is subjectively judged by learners of foreign languages, and pronunciation accuracy, which is defined as the similarity between a reference sentence and learner pronunciation. The independent variables are defined as sentence linguistic features and learner features, such as foreign language proficiency test scores. The experimental results demonstrate that the measured ease and accuracy of pronunciation has moderate correlation with the observed ease and accuracy (\(r = 0.69\)), and a significant contribution is observed in all the linguistic and learner features (\(p < 0.05\)).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bang, J., Lee, G.G.: Determining sentence pronunciation difficulty for non-native speakers. In: Proceedings of Speech and Language Technology in Education, pp. 132–136. International Speech Communication Association, Grenoble (2013)
Brown, J.D.: Testing in Language Programs. Prentice-Hall, New Jersey (1996)
Chall, J.S., Dial, H.E.: Predicting listener understanding and interest in newscasts. Educ. Res. Bull. 27(6), 141–153+168 (1948)
Cronbach, L.J.: Essentials of Psychological Testing, 3rd edn. Harper & Row, New York (1970)
Deterding, D.: The North Wind versus a Wolf: Short texts for the description and measurement of English pronunciation. J. Int. Phonetic Assoc. 36(2), 187–196 (2006)
Fang, I.E.: The easy listening formula. J. Broadcast. 11(1), 63–68 (1966)
Hwang, M.H.: How strategies are used to solve listening difficulties: Listening proficiency and text level effect. English Teach. 60(1), 207–226 (2005)
International Phonetic Association: Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet. Cambridge University Press, Cambridge (1999)
Kiyokawa, H.: A formula for predicting listenability: The listenability of English language materials 2. Wayo Women’s Univ. Lang. Literature 24, 57–74 (1990)
Kotani, K., Yoshimi, T.: Assessment of an index for measuring pronunciation difficulty. In: Proceedings of the 5th Workshop on Natural Language Processing Techniques for Educational Applications, pp. 119–124. Association for Computational Linguistics, Melbourne (2018)
Kotani, K., Yoshimi, T.: Machine learning classification of pronunciation difficulty for learners of English as a foreign language. Res. Corpus Linguist. 6, 1–8 (2018)
Lai, D.: A study on the influencing factors of online learners’ learning motivation. Higher Educ. Soc. Sci. 9(4), 26–30 (2015)
Li, W., Siniscalchi, S.M., Chen, N.F., Lee, C.H.: Improving non-native mispronunciation detection and enriching diagnostic feedback with DNN-based speech attribute modeling. In: Proceedings of 2016 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 6135–6139. The Institute of Electrical and Electronic Engineers, Shanghai (2016)
Sheridan, B., Puhl, L.: Evaluating an indirect measure of student literacy competencies in higher education using Rasch measurement. In: In Engelhard, G., Wilson, M. (eds.) Objective Measurement: Theory into Practice, vol. 3, pp. 19–44. Norwood, New Jersey (1996)
Wieling, M., Bloem, J., Mignella, K., Timmerneister, M., Nerbonne, J.: Measuring foreign accent strength in English: Validating levenshtein distance as a measure. Lang. Dyn. Change 4(2), 253–269 (2014)
Wilson, K.M.: Relating TOEIC Scores to Oral Proficiency Interview Ratings. Princeton, Educational Testing Services (1993)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kotani, K., Yoshimi, T. (2020). Multiple Linear Regression of Combined Pronunciation Ease and Accuracy Index. In: Nguyen, LM., Phan, XH., Hasida, K., Tojo, S. (eds) Computational Linguistics. PACLING 2019. Communications in Computer and Information Science, vol 1215. Springer, Singapore. https://doi.org/10.1007/978-981-15-6168-9_25
Download citation
DOI: https://doi.org/10.1007/978-981-15-6168-9_25
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-6167-2
Online ISBN: 978-981-15-6168-9
eBook Packages: Computer ScienceComputer Science (R0)