Skip to main content

Rating Scale Validation: An MTMM Approach

  • Chapter
  • First Online:
Nonverbal Delivery in Speaking Assessment
  • 412 Accesses

Abstract

On the basis of the rating scale formulated and further revised, the research project proceeds into the validation stage, where the rating scale is processed in a larger sample size validation with the quantitative method previously elaborated on so that the rating scale proposed can be statistically robust to validly measure the anticipated construct of communicative competence in candidates’ performance in group discussion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bachman, L.F., and A.S. Palmer. 1989. The construct validation of self-ratings of communicative language ability. Language Testing 6(4): 449–465.

    Google Scholar 

  • Bollen, K. A. 1989. Structural Equations with Latent Variables. John Wiley and Sons.

    Google Scholar 

  • Byrne, B.M. 2006. Structural equation modeling with EQS: Basic concepts, applications, and programming, 2nd ed. Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Byrne, B.M., and P.G. Bazana. 1996. Investigating the measurement of social and academic competencies for early/late preadolescents and adolescents: A multitrait-multimethod analysis. Applied Measurement in Education 9: 113–132.

    Article  Google Scholar 

  • Cheung, G.W., and R.B. Rensvold. 2002. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling 9(2): 233–255.

    Article  Google Scholar 

  • Kline, R.B. 2005. Principles and practice of structural equation modeling, 2nd ed. New York: The Guildford Press.

    Google Scholar 

  • Llosa, L. 2007. Validating a standards-based classroom assessment of english proficiency: A multi-trait multi-method approach. Language Testing 24(4): 489–515.

    Article  Google Scholar 

  • Raykov, T., and G.A Marcoulides. 2006. A first course in structural equation modeling (2nd ed.). Lawrence Erlbaum Associates, Inc.

    Google Scholar 

  • Rindskopf, D., and T. Rose. 1988. Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research 23: 51–67.

    Article  Google Scholar 

  • Sawaki, Y. 2007. Construct validation of analytic rating scales in a speaking assessment: Reporting a score profile and a composite. Language Testing 24(3): 355–390.

    Article  Google Scholar 

  • Sawaki, Y., L.J. Stricker, and A.H. Oranje. 2009. Factor structure of the TOEFL internet-based test. Language Testing 26(1): 5–30.

    Article  Google Scholar 

  • Schmitt, N., and D.M. Stults. 1986. Methodology review: Analysis of multi-trait multi-method matrices. Applied Psychological Measurement 10: 1–22.

    Article  Google Scholar 

  • Shin, S.K. 2005. Did they take the same test? Examinee language proficiency and the structure of language tests. Language Testing 22(1): 31–57.

    Article  Google Scholar 

  • Tabachnick, B.G., and L.S. Fidell. 2007. Using multivariate statistics, 5th ed. Needham Heights, MA: Allyn and Bacon.

    Google Scholar 

  • Widaman, K.F. 1985. Hierarchically tested covariance structure models for multi-trait multi-method data. Applied Psychological Measurement 9: 1–26.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mingwei Pan .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Pan, M. (2016). Rating Scale Validation: An MTMM Approach. In: Nonverbal Delivery in Speaking Assessment. Springer, Singapore. https://doi.org/10.1007/978-981-10-0170-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-0170-3_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-0169-7

  • Online ISBN: 978-981-10-0170-3

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics