Rating Scale Validation: An MTMM Approach



On the basis of the rating scale formulated and further revised, the research project proceeds into the validation stage, where the rating scale is processed in a larger sample size validation with the quantitative method previously elaborated on so that the rating scale proposed can be statistically robust to validly measure the anticipated construct of communicative competence in candidates’ performance in group discussion.


Factor Loading Discriminant Validity Baseline Model Method Factor Communicative Competence 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Bachman, L.F., and A.S. Palmer. 1989. The construct validation of self-ratings of communicative language ability. Language Testing 6(4): 449–465.Google Scholar
  2. Bollen, K. A. 1989. Structural Equations with Latent Variables. John Wiley and Sons.Google Scholar
  3. Byrne, B.M. 2006. Structural equation modeling with EQS: Basic concepts, applications, and programming, 2nd ed. Mahwah: Lawrence Erlbaum Associates.Google Scholar
  4. Byrne, B.M., and P.G. Bazana. 1996. Investigating the measurement of social and academic competencies for early/late preadolescents and adolescents: A multitrait-multimethod analysis. Applied Measurement in Education 9: 113–132.CrossRefGoogle Scholar
  5. Cheung, G.W., and R.B. Rensvold. 2002. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling 9(2): 233–255.CrossRefGoogle Scholar
  6. Kline, R.B. 2005. Principles and practice of structural equation modeling, 2nd ed. New York: The Guildford Press.Google Scholar
  7. Llosa, L. 2007. Validating a standards-based classroom assessment of english proficiency: A multi-trait multi-method approach. Language Testing 24(4): 489–515.CrossRefGoogle Scholar
  8. Raykov, T., and G.A Marcoulides. 2006. A first course in structural equation modeling (2nd ed.). Lawrence Erlbaum Associates, Inc.Google Scholar
  9. Rindskopf, D., and T. Rose. 1988. Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research 23: 51–67.CrossRefGoogle Scholar
  10. Sawaki, Y. 2007. Construct validation of analytic rating scales in a speaking assessment: Reporting a score profile and a composite. Language Testing 24(3): 355–390.CrossRefGoogle Scholar
  11. Sawaki, Y., L.J. Stricker, and A.H. Oranje. 2009. Factor structure of the TOEFL internet-based test. Language Testing 26(1): 5–30.CrossRefGoogle Scholar
  12. Schmitt, N., and D.M. Stults. 1986. Methodology review: Analysis of multi-trait multi-method matrices. Applied Psychological Measurement 10: 1–22.CrossRefGoogle Scholar
  13. Shin, S.K. 2005. Did they take the same test? Examinee language proficiency and the structure of language tests. Language Testing 22(1): 31–57.CrossRefGoogle Scholar
  14. Tabachnick, B.G., and L.S. Fidell. 2007. Using multivariate statistics, 5th ed. Needham Heights, MA: Allyn and Bacon.Google Scholar
  15. Widaman, K.F. 1985. Hierarchically tested covariance structure models for multi-trait multi-method data. Applied Psychological Measurement 9: 1–26.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Singapore 2016

Authors and Affiliations

  1. 1.Faculty of English Language and CultureGuangdong University of Foreign StudiesGuangzhouChina

Personalised recommendations