Skip to main content

Multiple Linear Regression of Combined Pronunciation Ease and Accuracy Index

  • Conference paper
  • First Online:
Computational Linguistics (PACLING 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1215))

  • 674 Accesses

Abstract

This study proposes an index for measuring the ease and accuracy of pronunciation that is derived by combining the ease and the accuracy of learners’ pronunciation, assesses the reliability and validity of the combined index, and develops a measurement method. The ease is a scale score for the ease of pronunciation that learners subjectively judged, and the accuracy demonstrates learners’ pronunciation performance. A previous study proposed an index regarding ease of pronunciation, and other previous studies independently proposed indices related to accuracy. These two types of indices should be combined because they have different aspects and compensate for each other. To develop the proposed measurement method, a learner corpus of pronunciation is compiled, and index reliability and validity are assessed using the classical test theory. The assessments demonstrate that the proposed index is moderately reliable and not valid. The proposed measurement method is developed using multiple linear regression analysis. The dependent variable is an index consisting of both pronunciation ease, which is subjectively judged by learners of foreign languages, and pronunciation accuracy, which is defined as the similarity between a reference sentence and learner pronunciation. The independent variables are defined as sentence linguistic features and learner features, such as foreign language proficiency test scores. The experimental results demonstrate that the measured ease and accuracy of pronunciation has moderate correlation with the observed ease and accuracy (\(r = 0.69\)), and a significant contribution is observed in all the linguistic and learner features (\(p < 0.05\)).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bang, J., Lee, G.G.: Determining sentence pronunciation difficulty for non-native speakers. In: Proceedings of Speech and Language Technology in Education, pp. 132–136. International Speech Communication Association, Grenoble (2013)

    Google Scholar 

  2. Brown, J.D.: Testing in Language Programs. Prentice-Hall, New Jersey (1996)

    Google Scholar 

  3. Chall, J.S., Dial, H.E.: Predicting listener understanding and interest in newscasts. Educ. Res. Bull. 27(6), 141–153+168 (1948)

    Google Scholar 

  4. Cronbach, L.J.: Essentials of Psychological Testing, 3rd edn. Harper & Row, New York (1970)

    Google Scholar 

  5. Deterding, D.: The North Wind versus a Wolf: Short texts for the description and measurement of English pronunciation. J. Int. Phonetic Assoc. 36(2), 187–196 (2006)

    Article  Google Scholar 

  6. Fang, I.E.: The easy listening formula. J. Broadcast. 11(1), 63–68 (1966)

    Article  Google Scholar 

  7. Hwang, M.H.: How strategies are used to solve listening difficulties: Listening proficiency and text level effect. English Teach. 60(1), 207–226 (2005)

    Google Scholar 

  8. International Phonetic Association: Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet. Cambridge University Press, Cambridge (1999)

    Google Scholar 

  9. Kiyokawa, H.: A formula for predicting listenability: The listenability of English language materials 2. Wayo Women’s Univ. Lang. Literature 24, 57–74 (1990)

    Google Scholar 

  10. Kotani, K., Yoshimi, T.: Assessment of an index for measuring pronunciation difficulty. In: Proceedings of the 5th Workshop on Natural Language Processing Techniques for Educational Applications, pp. 119–124. Association for Computational Linguistics, Melbourne (2018)

    Google Scholar 

  11. Kotani, K., Yoshimi, T.: Machine learning classification of pronunciation difficulty for learners of English as a foreign language. Res. Corpus Linguist. 6, 1–8 (2018)

    Article  Google Scholar 

  12. Lai, D.: A study on the influencing factors of online learners’ learning motivation. Higher Educ. Soc. Sci. 9(4), 26–30 (2015)

    Google Scholar 

  13. Li, W., Siniscalchi, S.M., Chen, N.F., Lee, C.H.: Improving non-native mispronunciation detection and enriching diagnostic feedback with DNN-based speech attribute modeling. In: Proceedings of 2016 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 6135–6139. The Institute of Electrical and Electronic Engineers, Shanghai (2016)

    Google Scholar 

  14. Sheridan, B., Puhl, L.: Evaluating an indirect measure of student literacy competencies in higher education using Rasch measurement. In: In Engelhard, G., Wilson, M. (eds.) Objective Measurement: Theory into Practice, vol. 3, pp. 19–44. Norwood, New Jersey (1996)

    Google Scholar 

  15. Wieling, M., Bloem, J., Mignella, K., Timmerneister, M., Nerbonne, J.: Measuring foreign accent strength in English: Validating levenshtein distance as a measure. Lang. Dyn. Change 4(2), 253–269 (2014)

    Article  Google Scholar 

  16. Wilson, K.M.: Relating TOEIC Scores to Oral Proficiency Interview Ratings. Princeton, Educational Testing Services (1993)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katsunori Kotani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kotani, K., Yoshimi, T. (2020). Multiple Linear Regression of Combined Pronunciation Ease and Accuracy Index. In: Nguyen, LM., Phan, XH., Hasida, K., Tojo, S. (eds) Computational Linguistics. PACLING 2019. Communications in Computer and Information Science, vol 1215. Springer, Singapore. https://doi.org/10.1007/978-981-15-6168-9_25

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-6168-9_25

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-6167-2

  • Online ISBN: 978-981-15-6168-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics