Skip to main content
SpringerLink
Log in

Question order effects in partial least squares path modelling: an empirical investigation

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

Effects of question order in surveys have been extensively researched. In the light of partial least squares path modeling, only few studies exist. In this study we analyze effects of question order with data from two waves of an annual satisfaction study. The positioning of area satisfaction questions and randomized attribute satisfaction questions was changed between the two waves. Results confirm previously described positive effects on explained variance if area satisfaction is asked after attribute satisfaction. This increase in explained variance in area performance does not lead to an improved model performance in explaining overall satisfaction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. See Henseler et al. (2016) for current discussion on the formative vs. composite discussion. This paper will use formative but the findings apply to composites as well.

References

  • Auh, S., Salisbury, L.C., Johnson, M.D.: Order effects in customer satisfaction modelling. J. Mark. Manag. 19(3–4), 379–400 (2003). doi:10.1080/0267257X.2003.9728215

    Article  Google Scholar 

  • Backhaus, K., Erichson, B., Weiber, R.: Fortgeschrittene Multivariate Analysemethoden, 3rd edn. Springer, Berlin (2015)

    Book  Google Scholar 

  • Bagozzi, R.P.: Causal Models in Marketing. Wiley, New York (1980)

    Google Scholar 

  • Coelho, P.S., Henseler, J.: Creating customer loyalty through service customization. Eur. J. Mark. 46, 331–356 (2012). doi:10.1108/03090561211202503

    Article  Google Scholar 

  • DeMoranville, C.W., Bienstock, C.C.: Question order effects in measuring service quality. Int. J. Res. Mark. 20(3), 217–231 (2003). doi:10.1016/S0167-8116(03)00034-X

    Article  Google Scholar 

  • Dijkstra, T.K., Henseler, J.: Consistent partial least squares path modeling. MIS Q. 39(2), 297–316 (2015)

    Article  Google Scholar 

  • Fornell, C.: A national customer satisfaction barometer: the Swedish experience. J. Mark. 56(1), 6–21 (1992). doi:10.2307/1252129

    Article  Google Scholar 

  • Fornell, C., Johnson, M., Anderson, E.W., Cha, J., Everitt Bryant, B.: The American customer satisfaction index: nature, purpose, and findings. J. Mark. 60(4), 7–18 (1996)

    Article  Google Scholar 

  • Garbarski, D., Schaeffer, N.C., Dykema, J.: The effects of response option order and question order on self-rated health. Qual. Life Res. 24(6), 1443–1453 (2014). doi:10.1007/s11136-014-0861-y

    Article  Google Scholar 

  • Geisser, S.: A predictive approach to the random effect model. Biometrika 61(1), 101–107 (1974)

    Article  Google Scholar 

  • Grice, P.: Logic and conversation. In: Cole, P., Morgan, J. (eds.) Syntax and Semantics, vol. 3, pp. 41–58. Academic Press, New York (1975)

    Google Scholar 

  • Hair, J.F., Hult, G.T.M., Ringle, C.M., Sarstedt, M.: A Primer on Partial Least Squares Structural Equation Modeling. Sage, Los Angeles (2014)

    Google Scholar 

  • Hayes, B.E.: Measuring Customer Satisfaction and Loyalty: Survey Design, Use, and Statistical Analysis Methods, 3rd edn. ASQ Quality Press, Milwaukee (2008)

    Google Scholar 

  • Hayes, D.P.: Item order and Guttman scales. Am. J. Sociol. 70, 51–58 (1964)

    Article  Google Scholar 

  • Heinz, A., Steffgen, G.: Führt eine negative Erfahrung mit der Polizei zwangsläufig zu einer negativen Bewertung der Polizei? Die Rolle von Assimilations- und Kontrasteffekten bei “part-whole question sequences”. Monatsschrift für Kriminologie und Strafrechtsreform 98(4), 320–334 (2015)

    Google Scholar 

  • Henseler, J.: A new and simple approach to multi-group analysis in partial least squares path modeling. In: Martens, H., Næs, T. (eds.) Proceedings of PLS’07 —The 5th International Symposium on PLS and Related Methods, pp. 104–107. Norway (2007)

  • Henseler, J., Hubona, G., Ash Ray, P.: Using PLS path modeling in new technology research: updated guidelines. Ind. Manag. Data Syst. 116(1), 2–20 (2016)

    Article  Google Scholar 

  • Henseler, J., Ringle, C.M., Sarstedt, M.: Using partial least squares path modeling in international advertising research: basic concepts and recent issues. In: Okazaki, S. (ed.) Handbook of Research in International Advertising, pp. 252–276. Edward Elgar Publishing, Cheltenham (2012)

    Google Scholar 

  • Henseler, J., Ringle, C.M., Sarstedt, M.: A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 43(1), 115–135 (2015). doi:10.1007/s11747-014-0403-8

    Article  Google Scholar 

  • Henseler, J., Ringle, C.M., Sinkovics, R.R.: The use of partial least squares path modeling in international marketing. Adv. Int. Mark. 20, 277–319 (2009)

    Google Scholar 

  • Höck, C., Ringle, C.M., Sarstedt, M.: Management of multi-purpose stadiums: importance and performance measurement of service interfaces. Int. J. Serv. Technol. Manag. 14(2–3), 188–207 (2011)

    Google Scholar 

  • Kaplan, S.A., Luchman, J.N., Mock, L.: General and specific question sequence effects in satisfaction surveys: integrating directional and correlational effects. J. Happiness Stud. 14(5), 1443–1458 (2013). doi:10.1007/s10902-012-9388-5

    Article  Google Scholar 

  • Kristensen, K., Eskildsen, J.: Design of PLS-based satisfaction studies. In: Vinzi, V.E., Chin, W.W., Henseler, J., Wang, H. (eds.) Handbook of Partial Least Squares: Concepts, Methods and Applications: Concepts, Methods and Applications in Marketing and Related Fields, pp. 247–277. Springer, Berlin (2010)

    Google Scholar 

  • Lohmöller, J.-B.: Latent Variable Path Modeling with Partial Least Squares. Physica, Heidelberg (1989)

    Book  Google Scholar 

  • Mittal, V., Kamakura, W.A.: Satisfaction, repurchase intent, and repurchase behavior: investigating the moderating effect of customer characteristics. J. Mark. Res. 38(1), 131–142 (2001)

    Article  Google Scholar 

  • Mittal, V., Ross, W.T., Baldasare, P.M.: The asymmetric impact of negative and positive attribute-level performance on overall satisfaction and repurchase intentions. J. Mark. 62(1), 33–47 (1998). doi:10.2307/1251801

    Article  Google Scholar 

  • Nunnally, J.C.: Psychometric Theory. McGraw-Hill, New York (1978)

    Google Scholar 

  • Ringle, C.M., Wende, S., Becker, J.-M.: SmartPLS 3 (Version 3.1.9). SmartPLS GmbH, Boenningstedt. Retrieved from www.smartpls.de (2015)

  • Sarstedt, M., Henseler, J., Ringle, C.: Multi-group analysis in partial least squares (PLS) path modeling: alternative methods and empirical results. In: Sarstedt, M., Schwaiger, M., Taylor, C.R. (eds.) Measurement and research methods in international marketing, pp. 195–218. Emerald Group Publishing Limited, Bingley (2011)

    Chapter  Google Scholar 

  • Schloderer, M.P., Sarstedt, M., Ringle, C.M.: The relevance of reputation in the nonprofit sector: the moderating effect of socio-demographic characteristics. Int. J. Nonprofit and Volunt. Sect. Mark. 19(2), 110–126 (2014). doi:10.1002/nvsm.1491

    Article  Google Scholar 

  • Schul, Y., Schiff, M.: Measuring satisfaction with organizations. Predictions from information accessibility. Public Opin. Q 57(4), 536–551 (1993). doi:10.1086/269394

    Article  Google Scholar 

  • Schuman, H., Presser, S.: Questions and Answers in Attitude Surveys: Experiments on Question form, Wording, and Context. Academic Press, New York (1981)

    Google Scholar 

  • Schwarz, N., Strack, F., Mai, H.-P.: Assimilation and contrast effects in part-whole question sequences: a conversational logic analysis. Public Opin. Q 55(1), 3–23 (1991)

    Article  Google Scholar 

  • Stone, M.: Cross-validatory choice and assessment of statistical predictions. J. Roy. Stat. Soc. Ser. B (Methodol.) 36(2), 111–147 (1974)

    Google Scholar 

  • Ulaga, W., Eggert, A.: Value-based differentiation in business relationships: gaining and sustaining key supplier status. J. Mark. 70(1), 119–136 (2006)

    Article  Google Scholar 

  • Völckner, F., Sattler, H., Hennig-Thurau, T., Ringle, C.M.: The role of parent brand quality for service brand extension success. J. Serv. Res 13(4), 379–396 (2010)

    Article  Google Scholar 

  • Wold, H.: Estimation of principal components and related models by iterative least squares. In: Krishnaiaah, P.R. (ed.) Multivariate Analysis, pp. 391–420. Academic Press, New York (1966)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Bamberg, Bamberg, Germany

    Jan Hendrik Schreier

  2. Institut für Automobil Forschung, Dortmund, Germany

    Niels Biethahn

  3. Harris Interactive AG, Hamburg, Germany

    Frank Drewes

Authors
  1. Jan Hendrik Schreier
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Niels Biethahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Frank Drewes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jan Hendrik Schreier.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schreier, J.H., Biethahn, N. & Drewes, F. Question order effects in partial least squares path modelling: an empirical investigation. Qual Quant 52, 71–84 (2018). https://doi.org/10.1007/s11135-017-0515-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-017-0515-6

Keywords

Search

Navigation