Skip to main content
SpringerLink
Log in
Book cover

Handbook of Statistical Modeling for the Social and Behavioral Sciences pp 77–183Cite as

Specification and Estimation of Mean Structures: Regression Models

  • Chapter

Abstract

A major activity in the social sciences is modeling the dependence of one or more outcome or dependent variables on some explanatory or predictor variables. As Hastie and Tibshirani (1990, chap. 4, sec. 2) point out, the goals of modeling this dependence are description (to find out more about the process by which the dependent variable is generated), inference (to detect the contribution of each explanatory variable for prediction), and prediction (to forecast the value of a dependent variable for a specific combination of the values of the explanatory variables).

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Amemiya, T. (1973), “Regression Analysis When the Dependent Variable Is Truncated Normal,” Econometrica, 41, 997–1016.

    Article  Google Scholar 

  • Amemiya, T. (1981), “Qualitative Response Models: A Survey,” Journal of Economic Literature, XIX, 1483–1536.

    Google Scholar 

  • Amemiya, T. (1985), Advanced Econometrics, Cambridge: Harvard University Press.

    Google Scholar 

  • Apostol, T. M. (1974), Mathematical Analysis, 2nd ed., Reading, Massachusetts.

    Google Scholar 

  • Arminger, G. (1992), “Residuals and Influential Points in Mean Structures Estimated with Pseudo Maximum Likelihood Methods,” in L. Fahrmeir, B. Francis, R.

    Google Scholar 

  • Gilchrist, and G. Tutz (eds.), Advances in GLIM and Statistical Modelling,New York, NY: Springer, pp. 20–26.

    Google Scholar 

  • Barndorff-Nielsen, O. (1978) Information and Exponential Families,New York: Wiley.

    Google Scholar 

  • Bates, D. M. and Watts, D. G. (1988), Nonlinear Regression and Its Applications, New York: John Wiley.

    Book  Google Scholar 

  • Becker, G. S. (1975), Human Capital, 2nd ed., New York: University of Chicago Press.

    Google Scholar 

  • Becker, R. A., Chambers, J. M., and Wilks, A. R. (1988), The New S Language,Pacific

    Google Scholar 

  • Grove, CA: Wadsworth and Brooks/Cole Advanced Books and Software.

    Google Scholar 

  • Begg, C. B., and Gray, R. (1984), “Calculation of Polychotomous Logistic Regression Parameters Using Individualized Regressions, ” Biometrika, 71, 11–18.

    Article  Google Scholar 

  • Belsley, D., Kuh, E., and Welsh, R. (1980), Regression Diagnostics, Identifying Influential Data and Sources of Collinearity, New York: Wiley.

    Google Scholar 

  • Berndt, E. R., Hall, B. H., Hall, R. E., and Hausman, J. A. (1974), “Estimation and Inference in Nonlinear Structural Models,” Annals of Economic and Social Measurement, 3, 653–666.

    Google Scholar 

  • BMDP (1981), BMDP Statistical Software 1981, Los Angeles: University of California Press.

    Google Scholar 

  • Bock, R. D. (1975), Multivariate Statistical Methods in Behavioral Research, New York: McGraw-Hill.

    Google Scholar 

  • Bock, R., and Jones, L. (1968), The Measurement and Prediction of Judgement and Choice, San Francisco: Holden Day.

    Google Scholar 

  • Bollen, K. A., and Jackman, R. W. (1985), “Regression Diagnostics: An Expository Treatment of Outliers and Influential Cases,” Sociological Methods and Research, 13, 510–542.

    Article  Google Scholar 

  • Börsch-Supan, A., and Vassilis, H. (1990), “Smooth Unbiased Multivariate Probability Simulators for Maximum Likelihood Estimation of Limited Dependent Variable Models,” Cowles Foundation Discussion Paper, No. 960, Yale University.

    Google Scholar 

  • Box, G. E. P, and Cox, D. R. (1964), “An Analysis of Transformations,” Journal of the Royal Statistical Society, 26, 211–252.

    Google Scholar 

  • Burguete, J. F., Gallant, R., and Souza, G. (1987), “On Unification of the Asymptotic Theory of Nonlinear Econometric Models,” Econometric Reviews, 2, 150–190.

    Google Scholar 

  • Clogg, C. C., Petkova, E., and Shidaheh, E. S. (1992), “Statistical Methods for Analyzing Collapsibility in Regression Models,” Journal of Educational Statistics, 17, 5174.

    Article  Google Scholar 

  • Cook, R. D. (1977), “Detection of Influential Observations in Linear Regression,” Technometrics, 19, 15–18.

    Article  Google Scholar 

  • Cook, R. D., and Weisberg, S. (1982), Residuals and Influence in Regression, New York: Chapman and Hall.

    Google Scholar 

  • Cook, R. D., and Weisberg, S. (1989), “Regression Diagnostics with Dynamic Graphics,” Technometrics, 31, 277–291.

    Google Scholar 

  • Copenhaver, T. W., and Mielke, P. W. (1977), “Quantit Analysis: A Quantal Assay Refinement,”Biometrics, 33, 175–186.

    Google Scholar 

  • Cox, D. R., and Hinkley, D. V. (1974), Theoretical Statistics, London: Chapman and Hall.

    Google Scholar 

  • Cox, D. R., and Wermuth, N. (1992), “A Comment on the Coefficient of Determination for Binary Responses,” The American Statistician, 46, 1–4.

    Google Scholar 

  • Daganzo, C. (1979), Multinomial Probit - The Theory and Its Application to Demand Forecasting, New York: Academic Press.

    Google Scholar 

  • Dagenais, M. G., and Dufour, J. M. (1991), “Invariance, nonlinear models, and asymptotic tests,”Econometrica, 59, No. 6, 1601–1615.

    Google Scholar 

  • Davidon, R., and MacKinnon, J. (1985), “Heteroskedasticity-Robust Tests in Regression Directions,” Annales de l’INSEE, 59 /60, 183–218.

    Google Scholar 

  • Debren, G. (1960), “Review of R. D. Luce, Individual Choice Behavior, ” American Economic Review, 50, 186–188.

    Google Scholar 

  • Dennis, J. E., and Schnabel, R. B. (1983), Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Efron, B. (1979), “Bootstrap Methods: Another Look at the Jackknife,” The Annals of Statistics, 7, 1–26.

    Article  Google Scholar 

  • Fahrmeir, L., and Kaufman, H. (1985), “Consistency and Asymptotic Normality of the Maximum Likelihood Estimator in Generalized Linear Models,” The Annals of Statistics, 13, 342–368.

    Article  Google Scholar 

  • Fisher, R. A. (1925), “Theory of Statistical Estimation,” Proceedings of the Cambridge Philosophical Society, 22, 700.

    Article  Google Scholar 

  • Flaig, G., Licht, G., and Steiner, V. (1993), “Testing for State Dependence Effects in a Dynamic Model of Male Unemployment Behaviour,” ZEW Discussion Paper, No. 93–07.

    Google Scholar 

  • Gabler, S., Laisney, F., and Lechner, M. (1993), Seminonparametric Estimation of Binary Choice Models With an Application to Labor-Force Participation,“ Journal of Business and Economic Statistics, 11, No. 1, 61–80.

    Google Scholar 

  • Gallant, A. R. (1987), Nonlinear Statistical Models, New York: Wiley.

    Book  Google Scholar 

  • GAUSS, Version 3.0 (1992), System and Graphics Manual, Kent, WA: Aptech Systems Inc.

    Google Scholar 

  • GLIM (1993), The GLIM System, Release 4 Manual, Oxford: Clarendon Press.

    Google Scholar 

  • Godfrey, L. G. (1988), Misspecification Tests in Econometrics, New York: Cambridge University Press.

    Google Scholar 

  • Goldberger, A. S. (1964), Econometric Theory, New York: Wiley.

    Google Scholar 

  • Goodnight, J. H. (1979), “A Tutorial on the Sweep Operator,” The American Statistician, 33, No. 3, 149–158.

    Google Scholar 

  • Gourieroux, C., Monfort, A., and Trognon, A. (1984), “Pseudo Maximum Likelihood Methods: Theory,” Econometrica, 52, 681–700.

    Article  Google Scholar 

  • Gourieroux, C., and Monfort, A. (1993), “Pseudo-Likelihood Methods,” in Maddala, G. S., Rao, C. R., and Vinod, H. D.: Handbook of Statistics, Vol. 11, Amsterdam. Elsevier.

    Google Scholar 

  • Greene, W. H. (1990), Econometric Analysis, New York: Macmillan.

    Google Scholar 

  • Härdle, W. (1990), Applied Nonparametric Regression, Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Hastie, T. J., Tibshirani, R. J. (1990), Generalized Additive Models, London: Chapman and Hall.

    Google Scholar 

  • Jennrich, R. I. (1969), “Asymptotic properties of nonlinear least squares estimators,” Annals of Mathematical Statistics, 40, 633–643.

    Article  Google Scholar 

  • Jobson, J. D., and Fuller, W. A. (1980), “Least Squares Estimation When the Covariance Matrix and Parameter Vector Are Functionally Related,” Journal of the American Statistical Association, 75, 176–181.

    Article  Google Scholar 

  • Kale, B. K. (1961), “On the Solution of the Likelihood Equation by Iteration Processes,” Biometrika, 48, 452–456.

    Google Scholar 

  • Kale, B. K. (1962), “On the Solution of the Likelihood Equation by Iteration Processes — The Multiparametric Case”, Biometrika, 48, 452–456.

    Google Scholar 

  • Kendall, M. and Stuart, A. (1977), The advanced Theory of Statistics, 4th ed., Vol. 1, London: Charles Griffin.

    Google Scholar 

  • Kohn, M., Manski, C., and Mundel, D. (1976), “An Empirical Investigation of Factors Influencing College-Going Behavior,” Annals of Economic and Social Measurement, 5, 391–419.

    Google Scholar 

  • Küsters, U. (1987), Hierarchische Mittelwert-und Kovarianzstrukturmodelle mit nichtmetrischen endogenen Variablen, Heidelberg: Physica Verlag.

    Book  Google Scholar 

  • Lafontaine, F., and White, K. J. (1986), “Obtaining Any Wald Statistic You Want,” Economics Letters, 21, 35–40.

    Article  Google Scholar 

  • Lerman, S. R., and Manski, C. F. (1981), “On the Use of Simulated Frequencies to Approximate Choice Probabilities,” in eds. C. F. Manski, and D. McFadden, Structural Analysis of Discrete Data With Econometric Applications, Cambridge, MA, pp. 305319.

    Google Scholar 

  • Li, K. C., and Duan, N. (1989), “Regression Analysis Under Link Violation,” The Annals of Statistics, 17, 1009–1052.

    Article  Google Scholar 

  • Liang, K. Y., and Zeger, S. L. (1986), “Longitudinal Data Analysis Using Generalized Linear Models,” Biometrika, 73, 13–22.

    Article  Google Scholar 

  • LIMDEP (1992), Version 6.0 — User’s Manual and Reference Guide, Bellport, NY: Econometric Software, Inc.

    Google Scholar 

  • Long, J. S., and Trivedi, P. K. (1993), “Some specification tests for the linear regression model,” in eds. K. A. Bollen, and J. S. Long, Testing Structural Equation Models, Newbury Park, CA: Sage Publications, pp. 66–110.

    Google Scholar 

  • MacKinnon, J. G. (1992), “Model Specification Tests and Artificial Regression,” Journal of Economic Literature, 30, 102–146.

    Google Scholar 

  • MacKinnon, J. G., and White, H. (1985), “Some Heteroskedasticity- Consistent Covariance Matrix Estimators with Improved Finite Sample Properties,” Journal of Econometrics, 29, 305–325.

    Article  Google Scholar 

  • Maddala, G. S. (1983), Limited Dependent and Qualitative Variables in Econometrics, Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Maddala, G. S., and Lee, L. F. (1976), “Recursive Models With Qualitative Endogenous Variables,” Annals of Economic and Social Measurement, 5 /4, 525–545.

    Google Scholar 

  • Manski, C. F. (1988), Analog Estimation Methods in Econometrics, New York: Chapman and Hall.

    Google Scholar 

  • Manski, C. F. (1991), “Regression,” Journal of Economic Literature, 29, 34–50.

    Google Scholar 

  • Manski, C. F. (1993), “Identification Problems in the social sciences,” in ed. P. V. Marsden, Sociological Methodology, 23, 1–56.

    Google Scholar 

  • McCullagh, P., and Nelder, J. A. (1989), Generalized Linear Models, 2nd ed., New York: Chapman and Hall.

    Google Scholar 

  • McDonald, R. P. (1978), “A Simple Comprehensive Model for the Analysis of Covariance Structures,” British Journal of Mathematical and Statistical Psychology, 31, 59–72.

    Article  Google Scholar 

  • McDonald, R. P. (1980), “A Simple Comprehensive Model for the Analysis of Covariance Structures: Some Remarks on Applications,” British Journal of Mathematical and Statistical Psychology, 33, 161–183.

    Article  Google Scholar 

  • McFadden, D. (1974), “Conditional Logit Analysis of Qualitative Choice Behavior,” in Zarembka, P.: Frontiers in Econometrics, New York: Academic Press, pp. 105–142.

    Google Scholar 

  • McFadden, D. (1981), “Econometric Models of Probabilistic Choice,” in C. F. Manski, and D. McFadden, Structural Analysis of Discrete Data with Econometric Applications, Cambridge, MA: Harvard University Press, pp. 198–272.

    Google Scholar 

  • McFadden, D. (1989), “A Method of Simulated Moments for Estimation of Discrete Response

    Google Scholar 

  • Models Without Numerical Integration,“ Econometrica,57, 995–1026.

    Google Scholar 

  • McKelvey, R. D, and Zavoina, W. (1975), “A Statistical Model for the Analysis of Ordinal Level Dependent Variables,” Journal of Mathematical Sociology, 4, 103–120.

    Article  Google Scholar 

  • McLain, D. H. (1974), “Drawing Contours From Arbitrary Data Points,” The Computer Journal, 17, 318–324.

    Article  Google Scholar 

  • Mincer, J. (1958), “Investment in Human Capital and Personal Income Distribution,” Journal of Political Economy, 66, 281–302.

    Article  Google Scholar 

  • Neider, J. A., and Wedderburn, R. W. M. (1972), “Generalized Linear Models,” Journal of the Royal Statistical Society, Ser. A, 135, 370–384.

    Google Scholar 

  • Nelson, F. D. (1976), “On a General Computer Algorithm for the Analysis of Models with Limited Dependent Variables,” Annals of Economic and Social Measurement, 5, 493–509.

    Google Scholar 

  • Pakes, A., and Pollard, D. (1989), “The Asymptotic Distribution of Simulation Experiments,” Econometrica, 57, 1027–1057.

    Article  Google Scholar 

  • Phillips, P. C. B., and Park, J. Y. (1988), “On the Formulation of Wald Tests of Nonlinear Restrictions,” Econometrica, 56, No. 5, 1065–1083.

    Article  Google Scholar 

  • Porst, R., and Zeifang, K. (1987), “A Description of the German General Social Survey Test-Retest Study and a Report on the Stability of the Sciodemographic Variables,” Sociological Methods and Research, 15, No. 3, 177–218.

    Article  Google Scholar 

  • Pregibon, D. (1980), “Goodness of Link Tests for Generalized Linear Models,”Applied Statistics,29,15–24.

    Google Scholar 

  • Pregibon, D. (1981), “Logistic Regression Diagnostics,” Annals of Statistics, 9, 705–724.

    Article  Google Scholar 

  • Ramsey, J. B. (1969), “Tests for Specification Errors in Classical Linear Least-Squares

    Google Scholar 

  • Regression Analysis,“ Journal of the Royal Statistical Society,Ser. B, 31, 350–371.

    Google Scholar 

  • Rao, C. R. (1973), Linear Statistical Inference and Its Applications, 2nd ed., New York: John Wiley.

    Book  Google Scholar 

  • Rosett, R. N., and Nelson, F. D. (1976), “Estimation of the Two-Limit Probit Regression Model,” Econometrica, 43, 141–146.

    Article  Google Scholar 

  • Rothenberg, T. J. (1971), “Identification in Parametric Models,” Econometrica, 39, 577–591.

    Article  Google Scholar 

  • Ruud, P. A. (1983), “Sufficient Conditions for the Consistency of Maximum Likelihood Estimation Despite Misspecification of Distribution in Multinomial Discrete Choice Models,” Econometrica, 51, 225–225.

    Article  Google Scholar 

  • Ruud, P. A. (1986), “Consistent Estimation of Limited Dependent Variable Models Despite Misspecification of Distribution,” Journal of Econometrics, 32, 157–187.

    Article  Google Scholar 

  • SAS (1988), SASISTAT User’s Guide, Release 6. 03, Cary, NC: SAS Institute.

    Google Scholar 

  • Schmidt, P. (1976), Econometrics, New York: Marcel Dekker.

    Google Scholar 

  • SPSS (1990), SPSS Reference Guide, Chicago: SPSS.

    Google Scholar 

  • Sobel, M., and Arminger, G. (1992), “Modelling Household Fertility Decisions: A Nonlinear Simultaneous Probit Model,” Journal of the American Statistical Association, 87, 38–47.

    Article  PubMed  Google Scholar 

  • Stewart, M. B. (1983), “On Least Squares Estimation When the Dependent Variable Is Grouped,” Review of Economic Studies, 50, 737–753.

    Article  Google Scholar 

  • Su, J. Q., and Wei, L. J. (1991), “A Lack-of-Fit Test for the Mean Function in a Generalized Linear Model, ” Journal of the American Statistical Association, 86, 420–426.

    Article  Google Scholar 

  • SYSTAT (1990), SYSTAT: The System for Statistics, Evanston, IL: SYSTAT, Inc.

    Google Scholar 

  • Theil, H. (1961), Economic Forecasts and Policy, Amsterdam: North Holland.

    Google Scholar 

  • Theil, H. (1971), Principles of Econometrics, New York: Wiley.

    Google Scholar 

  • Thurstone, L. (1927), “A Law of Comparative Judgement,” Psychological Review, 34, 273–286.

    Article  Google Scholar 

  • Tobin, J. (1958), “Estimation of Relationships for Limited Dependent Variables,” Econometrica, 26, 24–36.

    Article  Google Scholar 

  • Train, K. (1986), Qualitative Choice Analysis: Theory, Econometrics and an Application to Automobile Demand, Cambridge, MA: MIT Press.

    Google Scholar 

  • Tutz, G. (1990), Modelle für kategoriale Daten mit ordinalem Skalenniveau, Göttingen: Vandenhoeck and Ruprecht.

    Google Scholar 

  • Wagner, G. G., Schupp, J., and Rendtel, U. (1991), “The Socio-Economic Panel (SOEP) for Germany - Methods of Production and Management of Longitudinal Data,” Discussion Paper No. 31a, Deutsches Institut für Wirtschaftsforschung, Berlin.

    Google Scholar 

  • Wedderburn, R. W. M. (1974), “Quasi-Likelihood-Functions, Generalized Linear Models, and the Gauss-Newton-Method,” Biometrika, 61, 439–447.

    Google Scholar 

  • White, H. (1980), “A Heteroscedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroscedasticity,” Econometrica, 48, 817–838.

    Article  Google Scholar 

  • White, H. (1982), “Maximum Likelihood Estimation of Misspecified Models,” Econometrica, 50, 1–25.

    Article  Google Scholar 

  • White, H. (1983), “Corrigendum,” Econometrica, 51, No. 2, 513.

    Article  Google Scholar 

  • Wilkinson, G. N., and Rogers, C. E. (1973), “Symbolic Description of Factorial Models for Analysis of Variance,” Applied Statistics, 22, 392–399.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Economics, Bergische Universitä-GH Wuppertal, 42097, Wuppertal, Germany

    Gerhard Arminger

Authors
  1. Gerhard Arminger
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Economics, Bergische Universität-GH Wuppertal, D-42097, Wuppertal, Germany

    Gerhard Arminger

  2. Department of Sociology and Department of Statistics, Late of Pennsylvania State University, 16802, University Park, Pennsylvania, USA

    Clifford C. Clogg

  3. Department of Sociology, University of Arizona, 85721, Tucson, Arizona, USA

    Michael E. Sobel

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer Science+Business Media New York

About this chapter

Cite this chapter

Arminger, G. (1995). Specification and Estimation of Mean Structures: Regression Models. In: Arminger, G., Clogg, C.C., Sobel, M.E. (eds) Handbook of Statistical Modeling for the Social and Behavioral Sciences. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-1292-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4899-1292-3_3

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4899-1294-7

  • Online ISBN: 978-1-4899-1292-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation