Local Multilevel Modeling for Comparisons of Institutional Performance

  • Simona C. MinottiEmail author
  • Giorgio Vittadini
Conference paper
Part of the Studies in Classification, Data Analysis, and Knowledge Organization book series (STUDIES CLASS)


We propose a general methodology for evaluating the quality of public sector activities such as education, health and social services. The traditional instrument used in comparisons of institutional performance is Multilevel Modeling (Goldstein, H., Multilevel statistical models, Arnold, London, 1995). However, rankings based on confidence intervals of the organization-level random effects often prevent to discriminate between institutions, because uncertainty intervals may be large and overlapped. This means that, in some situations, a single global model is not sufficient to explain all the variability, and methods able to capture local behaviour are necessary. The proposal, which is entitled Local Multilevel Modeling, consists of a two-step approach which combines Cluster-Weighted Modeling (Gershenfeld, N., The nature of mathematical modeling, Cambridge University Press, Cambridge, 1999) with traditional Multilevel Modeling. An example regarding the evaluation of the “relative effectiveness” of healthcare institutions in Lombardy region is discussed.



The authors would like to express their thanks to Maurizio Sanarico for his valuable advice.


  1. Bryk, A. S., & Raudenbush, S. W. (2002). Hierarchical linear models. Applications and data analysis methods. Newbury Park, CA: Sage.zbMATHGoogle Scholar
  2. Engster, D., & Parlitz, U. (2006). Local and cluster weighted modeling for time series prediction. In B. Schelter, M. Winterhalder, & J. Timmer (Eds.), Handbook of time series analysis. Recent theoretical developments and applications (pp. 39–65). Weinheim: Wiley.Google Scholar
  3. Galimberti, G., & Soffritti, G. (2007). Multiple cluster structures and mixture models: Recent developments for multilevel data. In Book of short papers CLADAG 2007 “Meeting of the Classification and Data Analysis Group of the Italian Statistical Society” (pp. 203–206), September 12–14, Università degli Studi di Macerata. EUM, Macerata.Google Scholar
  4. Gershenfeld, N. (1999). The nature of mathematical modeling. Cambridge: Cambridge University Press.zbMATHGoogle Scholar
  5. Goldstein, H. (1995). Multilevel statistical models. London: Arnold.Google Scholar
  6. Goldstein, H., & Spiegelhalter, D. J. (1996). League tables and their limitations: Statistical issues in comparisons of institutional performance. JRSS A, 159(3), 385–443.Google Scholar
  7. Lilford, R., Mohammed, M. A., Spiegelhalter, D. J., & Thomson, R. (2004). Use and misuse of process and outcome data in managing performance of acute medical care: Avoiding institutional stigma. The Lancet 363, 1147–1154.CrossRefGoogle Scholar
  8. McLachlan, G. J., & Basford, K. E. (1988). Mixture models: Inference and applications to clustering. New York: Marcel Dekker.zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  1. 1.Dipartimento di StatisticaUniversità degli Studi di Milano-BicoccaMilanoItaly

Personalised recommendations