Skip to main content

Log-Linear Models: Interpretation

  • Chapter
  • First Online:
  • 3122 Accesses

Part of the book series: Springer Texts in Statistics ((STS))

Abstract

This chapter starts with the specification and handling of regression type problems for categorical data. The log-linear parameters can be transformed into multiplicative parameters, and these are useful in dealing with the regression problem for categorical variables, where this approach provides a clear and testable concept of separate effects versus joint effect of the explanatory variables. Further topics related to the use of log-linear models in data analysis are also considered. First, the selection and interpretation of log-linear models are illustrated in regression type and non-regression type problems, using real data sets. Two special classes of log-linear models, decomposable and graphical log-linear models, are presented next. Decomposable log-linear models may be seen as direct generalizations of conditional independence. Graphical log-linear models, which are the basis of many current applications of log-linear models, may also be interpreted using generalized conditional independence statements, called Markov properties. Further, these models admit a representation using graphs, where the nodes are the variables in the model. Next, a representation of every log-linear model as the intersection of several log-linear models is discussed, where all of the latter models belong to one of two classes of simple log-linear models. One is the model of conditional joint independence of a group of variables, given all other variables (and graphical log-linear models) may be represented as intersections of such models only and (in the case of non-graphical models) no highest-order conditional interaction among a group of variables.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    One might think that in a data analytic situation, model fit cannot be worse by allowing more interactions, that is, a larger model. Indeed, the test statistics measuring the deviation between observed and estimated data are not going to be bigger, but they are evaluated against different reference distributions because of the different degrees of freedom. Therefore, one cannot guarantee that a larger model will always show better fit to the data.

  2. 2.

    Here the data can be population data, but in the usual setup of statistics, such decisions are done by applying tests of hypotheses to data from a sample.

  3. 3.

    See [70] for simulation results about using the asymptotic chi-squared distributions as reference distributions for finite samples.

  4. 4.

    In 1988, Chile had a referendum, where voters were asked to decide, whether the then de facto leader of the country should or should not remain in power for another 8 years. The leader was Augusto Pinochet, who had assumed power in 1973 as a result of a military coup d’état.

  5. 5.

    Because this is a regression type analysis, the association between the response and some of the explanatory variables is interpreted as the effect of the latter.

  6. 6.

    This situation is often called independent effects, but the word independence is used in so many meanings in statistics that separable may be a clearer description.

  7. 7.

    These will be discussed in Sect. 12.1.

  8. 8.

    Similarly, it is possible that in a regression type analysis, one allows the highest-order interaction among the explanatory variables but would obtain a higher p-value if this interaction was omitted.

  9. 9.

    Or effect parameterization, see Sect. 10.2.

  10. 10.

    The complement graph has the same nodes as the original, and two nodes are connected if and only if they are not connected in the original graph.

References

  1. Edwards, D., Havranek, T.: A fast procedure for model search in contingency tables. Biometrika, 72, 339–351 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  2. Fox, J., Andersen, R.: Effect displays for multinomial and proportional-odds logit models. Sociological Methodology 36, 225–255 (2006)

    Google Scholar 

  3. Fox, J., Weisberg, S.: An R Companion to Applied Regression, Second Edition. Thousand Oaks CA: Sage. URL: http://socserv.socsci.mcmaster.ca/jfox/Books/Companion (2011)

    Google Scholar 

  4. Hosmer, D.W., Lemeshow, S.: Applied Logistic Regression, 2nd ed. Wiley, New York (2000)

    Book  MATH  Google Scholar 

  5. Lauritzen, S.L.: Graphical Models. Clarendon Press, Oxford (1996)

    MATH  Google Scholar 

  6. Leimer, H.-G., Rudas, T.: Conversion between GLIM- and BMDP-type log-linear parameters. GLIM Newsletter, 19, 47 (1989)

    Google Scholar 

  7. Miller, R: Simultaneous Statistical Significance, 2nd ed.. Springer, New York (1981)

    Google Scholar 

  8. Rudas, T.: A Monte Carlo comparison of the small sample behaviour of the Pearson, the likelihood ratio and the Cressie-Read statistics. Journal of Statistical Computation and Simulation, 24, 107–120 (1986)

    Article  Google Scholar 

  9. Rudas, T.: Canonical representation of log-linear models. Communications in Statistics – Theory and Methods, 31, 2311–2323 (2002)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Science+Business Media, LLC, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Rudas, T. (2018). Log-Linear Models: Interpretation. In: Lectures on Categorical Data Analysis. Springer Texts in Statistics. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-7693-5_11

Download citation

Publish with us

Policies and ethics