Crisis and chaos in behavioral nutrition and physical activity
- 6.6k Downloads
Resnicow & Vaughn challenged the field of behavioral nutrition and physical activity to conduct research in new ways. They challenged the predictiveness of our models, sensitivity to initial conditions, factors predisposing to change and measurement procedures. While the predictiveness of our models will reflect the sophistication of our thinking and research, and the sensitivity to initial conditions is subsumed under the sophistication of our models, research on conditions predisposing to change (e.g. epiphanies), more longitudinal designs, refined measurement procedures and testing of critical issues can only enhance the quality of our research. Improved research quality should lead to enhanced efficacy and effectiveness of our interventions, and thereby our making meaningful contributions to mitigating the chaos in our field and the crisis from the rising epidemic of obesity.
KeywordsPhysical Activity Item Response Theory Tipping Point Underlying Variable Obesity Prevention Program
Item Response Theory
In this context, Resnicow & Vaughn  challenged our "same old" way of thinking about our field. They correctly specified the assumption of linearity in our predictive models, and proposed Chaos and Dynamic Systems Theories as alternative nonlinear models. They did not throw out all our theories per se, but challenged how we interrelated the variables, how we related them to behaviors, and offered some new variables predisposing to change. While Glass & McAtee  recently pointed out deficiencies in the social dimensions of our research, Resnicow & Vaughn targeted our thinking about behavior change. Some of the issues they raised are non-issues, but others deserve that we morph our basic methods to test the new ideas.
Since we use statistical methods, all our models are by definition probabilistic, rather than deterministic (unless we could account for 100% of the variance, which will not happen in our lifetimes).
A key issue in their article was the predictiveness of our current models. They correctly identified the very limited predictiveness of the current models. The key issue, however, is the level of predictiveness that could possibly be achieved in predicting behavior. For example, our biological research colleagues are not satisfied unless their models account for 90% or more of the variance in their phenomena of interest. We are well below that . Resnicow & Vaughn have not taken into account the emerging research on environmental influences, e.g. home availability , neighborhood characteristics [18, 19]; biological influences, e.g. genes , sensitivity to tastes , the hormone rages of adolescent development [22, 23]; emotional influences [23, 24]; nor the likely interrelationships and interactions among these variables and our more usual psychosocial and behavioral predictors [25, 26]. The higher the predictiveness of our models, the more we can engage in our logical approach to designing interventions based on these models. The larger number of and more diverse variables incorporated into these models, the more complex our interventions will need to be to address components of the model. And the interventions will need to both segment the population for differing types of interventions to different gender, age, ethnic, socioeconomic, and/or neighborhood groups, and tailor the intervention to individual characteristics within these groups . At this time, we need to build and test the more comprehensive models. This is a daunting, but exciting, challenge.
Resnicow & Vaughn proposed the principal of sensitivity to initial conditions, as if this were a new idea. All of our models of longitudinal relationships (as equations) have built into them sensitivity to initial conditions, i.e. the initial values of the variables. How diverse the outcomes depends on the nature of the relationships. As our models become more comprehensive and complex, fairly similar initial conditions could lead to quite divergent outcomes. In part this is a function of the sophistication of our knowledge base. We need to build more sophisticated predictive models.
The idea of a tipping point or when it might occur, is not well defined . In some ways it reifies a change, as if there is something intrinsic to or magical about the change process. If a tipping point is nothing more than a critical point on a variable beyond which change occurs, it is not clear the concept adds much, but identifying those points would be helpful.
Issues deserving intensive research
Investigators could take away from the Resnicow & Vaughn message that change is random and cannot be predicted, and thereby cannot be understood by our usual research methods on behavior or its change. This would be very unfortunate. Resnicow & Vaughn will have made a major contribution, only if it leads to innovative research and new insights. Even in the vast complexities of molecular science, investigators are hammering away at delineating linear and nonlinear patterns to better understand the biology. Chances are we can do the same in behavior research.
Resnicow & Vaughn proposed that change does not occur in a linear "persuasion slowly overcoming resistance" manner, but rather in what they characterized as "quantum leaps," i.e. an epiphany or "aha!" event occurs from which the person decides to change. This is an interesting idea and should be testable. Innovative methods will be needed to identify people soon after the aha! experience to learn more about it. Perhaps interviewing new recruits to Weight Watchers™ or to fitness centers would accomplish this? A related issue would be what could we do to encourage aha! experiences? Are they a response to an overload of information (probably not, since we have done a lot of this already)? To repeated thinking about the issues (we could program prompts to thinking)? To setting off some emotional experience related to the behavior (we might be able to tailor messages to issues people found emotionally charged)? Resnicow & Vaughn invoked the concept of "cues" from the Health Belief Model. There has been some research on cues [29, 30, 31], but this has not as yet led to substantial insights. Relating cues to aha! experiences could be an important avenue for research. Developing valid and reliable retrospective methods to identify and recall aha! experiences would be necessary to make much progress.
Resnicow & Vaughn correctly pointed out the cross sectional nature of most of our research. Dynamic Systems modeling proposes that dynamic research be done, and this would be focused on change over time which requires longitudinal designs . The importance of longitudinal designs was emphasized when Nigg  found that physical activity predicted ensuing self efficacy, but not the other way around. If self efficacy is really caused by physical activity, but doesn't cause physical activity, it doesn't make sense to try to increase self efficacy in interventions. While it is challenging to recruit and maintain longitudinal cohorts, such cohorts are required to address issues of direction of causality and thereby which variables should be targets for change in intervention programs. While ten year cohorts may not be necessary, perhaps 3 mo or 6 mo cohorts would provide tests for the changes we need. Longitudinal dynamic systems research has been initiated in other fields [34, 35], which should provide a guide for our further development.
Whether behavior change can only be understood in retrospect instead of prospectively is an empirical issue. In part this is a function of how much variance our models will ultimately predict. Perhaps a few retrospective analyses will be necessary, perhaps using qualitative methods, to map out the processes occurring? But predictive science should be where we are headed, since predictive relationships clearly demonstrate what we know.
Resnicow & Vaughn correctly identified our current approaches to measurement as providing severe limitations to how we could understand our phenomena of interest. There have been limits on the extent to which existing measurement methods (e.g. classical test theory) have been used and reported , and limits on the predictiveness of existing measurement models . One innovation in measurement theory that has recently drawn attention is Item Response Theory (IRT) . IRT fits latent variables to items (and respondents) which identifies portions of the underlying variable being poorly measured , and assesses reliability across the range of the underlying variable [39, 40]. Having items measuring specific locations on the underlying variable permits an assessment of whether the measures work differently after participation in an experiment ; differ by ethnic, gender or other groupings; and permit more efficient multidimensional modeling of the variable . Use of IRT offers great promise for better understanding and minimizing the problems due to measurement of our constructs, and deserves much wider use.
An issue Resnicow addressed in his oral presentation in Boston (but not in his paper) was the falsifiability of a theory, and whether our current cognitive models are really theories. He correctly stated that in our current approach to research, no theories have been discarded (which would be considered a sign of progress and development in a field). Our best current research fits multivariate models to sets of variables , and determines which variables were significantly related to other variables in the model. This is useful for assessing the predictiveness of particular variables in certain situations, but does not necessarily address the usefulness of the larger theory. To move our field forward we need more attention to theoretical issues in our research, tests of clearer more specific predictions from theory applied to particular issues [44, 45], and delineation of "critical issues" where two theories would make different predictions or model fitting research would need to test the fit of competing models , where the alternative models were predicated on different theories. More highly controlled experimental research on critical issues will also be necessary. Accumulation of findings across "critical" studies would enable the field to find more comprehensive and more predictive theoretical frameworks, and capitalize upon them in more likely to be effective interventions. There has been a distaste for theory in our field , and some have proposed continuing conducting intervention research until randomly hitting on intervention procedures that work . Alternatively, I believe highly predictive theory should guide the design of effective interventions. In a complicated set of many possible variables and relationships, a random search may never result in finding effective change techniques, and even if it did, we wouldn't have the conceptual framework to understand why it happened in order to exploit it.
Resnicow & Vaughn challenged the field of behavioral nutrition and physical activity to conduct research in new ways. While the predictiveness of our models will reflect the sophistication of our thinking and research, and the sensitivity to initial conditions is subsumed under the sophistication of our models, research on conditions predisposing to change (e.g. epiphanies), more longitudinal designs, refined measurement procedures and testing of critical issues can only enhance the quality of our research. Improved research quality should lead to enhanced efficacy and effectiveness of our interventions, and thereby our making meaningful contributions to mitigating the chaos in our field and the crisis from the rising epidemic of obesity.
This work is in part a publication of the United States Department of Agriculture (USDA/ARS) Children's Nutrition Research Center, Department of Pediatrics, Baylor College of Medicine, Houston, Texas, and was funded in part with federal funds from the USDA/ARS under Cooperative Agreement No. 58-6250-6001. The contents of this publication do not necessarily reflect the views or policies of the USDA, nor does mention of trade names, commercial products, or organizations imply endorsement from the U.S. government.
- 4.Malecka-Tendera E, Mazur A: Childhood obesity: a pandemic of the twenty-first century. Int J Obes (Lond). 2006, S1-3. 10.1038/sj.ijo.0803367. 30 Suppl 2Google Scholar
- 6.Avenell A, Broom J, Brown TJ, Poobalan A, Aucott L, Stearns SC, Smith WC, Jung RT, Campbell MK, Grant AM: Systematic review of the long-term effects and economic consequences of treatments for obesity and implications for health improvement. Health Technol Assess. 2004, 8 (21): iii-iv. 1–182CrossRefGoogle Scholar
- 7.Flynn MA, McNeil DA, Maloff B, Mutasingwa D, Wu M, Ford C, Tough SC: Reducing obesity and related chronic disease risk in children and youth: a synthesis of evidence with 'best practice' recommendations. Obes Rev. 2006, 7-66. 10.1111/j.1467-789X.2006.00242.x. 7 Suppl 1Google Scholar
- 14.Resnicow K, Vaughn : A chaotic view of behavior change: a quantum leap for health promotion. IJBNPA.Google Scholar
- 16.Baranowski T, Cullen KW, Baranowski J: Psychosocial correlates of dietary intake: Advancing intervention. Annual Review of Public Health. 1999, 19: 17-40.Google Scholar
- 17.Jago R, Baranowski T: Home food availability: A microenvironmental mediating variable?. Public Health Nutrition. 2006,Google Scholar
- 18.van der Horst K, Oenema A, Ferreira I, Wendel-Vos W, Giskes K, van Lenthe F, Brug J: A systematic review of environmental correlates of obesity-related dietary behaviors in youth. Health Educ Res. 2006Google Scholar
- 22.Himes JH, Obarzanek E, Baranowski T, Wilson DM, Rochon J, McClanahan BS: Early sexual maturation, body composition, and obesity in African American girls. Obes Res. 2004, 64S-72S. 12 SupplGoogle Scholar
- 28.Gladwell M: The Tipping Point – How Little Things Can Make a Big Difference. 2002, New York, NY: Back Bay BooksGoogle Scholar
- 37.Wilson M, Allen D, Li H: Comparing item response modeling with the Classical Test Theory approach in measurement in the behavioral sciences. Health Educ Res. 2007,Google Scholar
- 38.Wilson M: Constructing Measures: An Item Response Modeling Approach. 2005, Mahwah, N.J.: ErlbaumGoogle Scholar
- 39.Watson K, Thompson D, Baranowski T: Item response theory evaluation of the children's fruit and vegetable self efficacy scale. Health Education Research. 2007,Google Scholar
- 40.Wilson M, Allen DD, Li JC: Improving measurement in behavioral sciences using item response models: comparison with the classical test theory approach. Health Educ Res. 2006:Jul 31 [Epub]Google Scholar
- 41.Baranowski T, Allen D, Masse L, Wilson M: Does participation in an intervention affect responses on self report questionnaires?. Health Educ Res. 2006,Google Scholar
- 42.Watson K, Baranowski T, Thompson D, Jago R, Baranowski J, Klesges L: Innovative Application of a Multidimensional Item Response Model In Assessing the Influence of Social Desirability on the Pseudo-Relationship between Self-Efficacy and Behavior. Health Educ Res.Google Scholar
- 43.Motl RW, Dishman RK, Saunders RP, Dowda M, Pate RR: Perceptions of Physical and Social Environment Variables and Self-Efficacy as Correlates of Self-Reported Physical Activity Among Adolescent Girls. J Pediatr Psychol. 2006:May 17 [Epub]Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.