Abstract
This paper presents predictive validity study, first applied to Japanese writing test in China, a preliminary research regarding the analysis of Japanese writing test score data obtained from a particular Japanese writing test. A detailed description about the inter-rater inconsistency was also discussed. The study shows that the actual ratings given by Chinese and Japanese teachers were corelated, but the significance lies in the application of such a method first conducted by Chinese teachers of Japanese in their teaching practice. Such a study usually applied to tests of English in China is now used by Chinese teachers of Japanese in their Japanese teaching and testing, showing a significant step towards promoting the use of statistical method to improve the reliability of Japanese writing test in China and a new direction for the research of Japanese language test in China as well.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
The present author used keyword search “Rasch model, item response theory, Japanese test” to retrieve China’s largest periodical full-text database—CNKI journals but did not find the use of Rasch model applied to study Japanese language tests.
- 2.
Source from the latest survey report 2013 by Japan Foundation, “Japanese foreign educational institutions.
References
Bachman, L. F. (2004). Statistical analyses for language assessment. Cambridge: Cambridge University Press.
Bond, T. & Fox, C. (2001). Rasch Model.
Hughes, A. (1989). Testing for language teachers. UK: Cambridge University Press.
Kawakami, M. (2005). A study of evaluation items for a proposal of evaluation criteria of many applications for writing: A fact-finding inquiry on teachers. ICU Studies in Japanese Language Education, 2005(2), 23–33.
Kikuchi, Y. (1987). The study of grading method in the writing test. Japanese Language Education, 63, 87–104.
Komuro, T., Mitani, S., & Murakami, K. (2005). The study of reliability and grading criteria on the writing test of EJU. Janan.lnguage and culture, 2004(3), 55–69.
Mok, M. M. C. & Zhang, Q. (2014). Constructing variables. Book of abstracts. Journal of Applied Measurement (Vol. 2). ISBN 978-1-934116-10-4. JAM Press P.O. Box 1283, Maple Grove, MN55311, USA.
Mok, M. M. C., & Zhang, Q. (2015). Constructing variables. Book of abstracts. Journal of Applied Measurement (Vol. 1). ISBN 978-1-934116-10-4. JAM Press P.O. Box 1283, Maple Grove, MN55311, USA.
Shi-chun, G., Li, W., & Zhang, Q. (1995). The Application of IRT to MET Equating. Guang Ming Press, Beijing.
Wei, Z. (2013). The review and status of domestic studies on Japanese language testing. Foreign Language Research in Northeast Asia, 2013(2), 77–83.
Ying, H. W. (2011). A comparative analysis for the behaviors of scoring English writing test, 2011(4), 27–32.
Zhang, Q. (2011). Towards better interaction between testing and teaching. Keynote speaker at the 5th National TEFL/1st Mongolia TESOL Conference, Ulaanbaatar, Mongolia, Oct 7–9, 2011.
Zhang, Q. (2012a). Towards international practice of language testing in China. Keynote speaker at the PROMS2012, Jiaxing, China, August 6–9, 2012.
Zhang, Q. (2012b). A pilot study based on Rasch into the appropriateness of the TOEIC bridge test for Chinese students: Status quo and prospect at the PROMS2012, Jiaxing, China, August 6–9, 2012.
Zhang, Q. (2013a). Invited keynote speaker at pacific-rim objective measurement symposium hosted by National Sun Yat-sen University, Kaohsiung, Taiwan, July 31–August 3, 2013.
Zhang, Q. (2013b). Rasch model and MET equating. Invited keynote speaker at assessment conference jointly hosted by the HONGKONG Institute of Education and Education Bureau, the Government of the KONG KONG Special Administrative Region, January 15–16, 2013.
Zhang, Q. (2014). Invited keynote speaker at pacific-rim objective measurement symposium hosted by Jiaxing University, Guangzhou, China, August 2–6, 2014.
Zhang, Q. (2015a). An overview of Rasch model: Status quo and prospect in China Invited Speaker at the 13th Asia TEFL International Conference hosted by Nanjing University: Creating the Future for ELT in Asia: Opportunities and Directions, Nanjing, China, November 6–8, 2015.
Zhang, Q. (2015b). The feedback function of learning assessment on teaching in the case of English subject, Invited Speaker at Conferência sobre “ Avaliação diverificade-Impulsionar o sucesso n aprendizagem dos alunos” hosted by Direcção dos Serviços de Educação e Juvenude, Governo da Região Administrativa Especial de Macau, SAR, November 6–7, 2015.
Zhang, Q., et al. (2015a). Rasch model: Status quo and prospect in China. Pacific-rim objective measurement symposium (PROMS) 2014 conference proceeding. ISBN 978-3-662-47489-1, on Springer.com.
Zhang, Q., et al. (2015b). A Rasch-based approach for comparison of English listening comprehension between CET and GEPT. Pacific-rim objective measurement symposium (PROMS) 2014 conference proceeding. ISBN 978-3-662-47489-1, on Springer.com.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media Singapore
About this paper
Cite this paper
Huang, JC., Zhang, KM., Zhang, Q. (2016). A Preliminary Validity Study of Scoring for Japanese Writing Test in China. In: Zhang, Q. (eds) Pacific Rim Objective Measurement Symposium (PROMS) 2015 Conference Proceedings. Springer, Singapore. https://doi.org/10.1007/978-981-10-1687-5_19
Download citation
DOI: https://doi.org/10.1007/978-981-10-1687-5_19
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-1686-8
Online ISBN: 978-981-10-1687-5
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)