Skip to main content
SpringerLink
Log in

Response Processes and Measurement Validity in Health Psychology

  • Chapter
  • First Online:
Book cover Understanding and Investigating Response Processes in Validation Research

Part of the book series: Social Indicators Research Series ((SINS,volume 69))

Abstract

In this chapter, we examine the importance of understanding and attending to people’s response processes within the context of health psychology assessment. From a validity perspective (cf. Messick, Am Psychol 50:741–749, 1995) it is critical that individuals’ responses to psychological assessments align with what is purported to be assessed within a given measurement procedure. If this does not happen, this can have non-trivial implications for not only failing to understand certain psychological processes, but can also result in interventions that are misdirected or poorly conceived. In this chapter, we consider some of these issues in the context of health psychology, and highlight a range of methodological approaches that can enhance the substantive aspects of validity (cf. Messick, Am Psychol 50:741–749, 1995) in relation to assessment within the health field. Specifically, we discuss the potential utility of think aloud procedures, implicit measures, as well as two forms of behavioural assessment (eye-tracking technology and performance-based measures).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi:10.1016/0749-5978(91)90020-T.

    Article  Google Scholar 

  • Anderson, E. S., Winett, R. A., & Wojcik, J. R. (2007). Self-regulation, self-efficacy, outcome expectations, and social support: Social cognitive theory and nutrition behavior. Annals of Behavioral Medicine, 34, 304–312. doi:10.1007/BF02874555.

    Article  Google Scholar 

  • Anderson, P., De Bruijn, A., Angus, K., Gordon, R., & Hastings, G. (2009). Impact of alcohol advertising and media exposure on adolescent alcohol use: A systematic review of longitudinal studies. Alcohol and Alcoholism, 44, 229–243. doi:10.1093/alcalc/agn115.

    Article  Google Scholar 

  • Arora, S., Ashrafian, H., Davis, R., Athanasiou, T., Darzi, A., & Sevdalis, N. (2010). Emotional intelligence in medicine: A systematic review through the context of the ACGME competencies. Medical Education, 44, 749–764. doi:10.1111/j.1365-2923.2010.03709.x.

    Article  Google Scholar 

  • Ashkanasy, N. M., & Humphrey, R. H. (2011). Current emotion research in organizational behavior. Emotion Review, 3, 214–224. doi:10.1177/1754073910391684.

    Article  Google Scholar 

  • Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191–215. doi:10.1037/0033-295X.84.2.191.

    Article  Google Scholar 

  • Bandura, A. (1978). Reflections on self-efficacy. Advances in Behaviour Research and Therapy, 1, 237–269. doi:10.1016/0146-6402(78)90012-7.

    Article  Google Scholar 

  • Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NY: W.H. Freeman and Co.

    Google Scholar 

  • Bandura, A. (2004). Health promotion by social cognitive means. Health Education and Behavior, 3, 143–164. doi:10.1177/1090198104263660.

    Article  Google Scholar 

  • Bandura, A. (2006). Guide for constructing self-efficacy scales. In F. Pajares & T. C. Urdan (Eds.), Self-efficacy beliefs of adolescents (pp. 307–337). Greenwich, UK: Information Age.

    Google Scholar 

  • Bar-On, R. (1997). Bar-On emotional quotient inventory: Technical manual. Toronto, ON: Multi-Health Systems.

    Google Scholar 

  • Bassett-Gunter, R. L., Latimer-Cheung, A. E., Martin Ginis, K. A., & Castelhano, M. (2014). I spy with my little eye: Cognitive processing of framed physical activity messages. Journal of Health Communication, 19, 676–691. doi:10.1080/10810730.2013.837553.

    Article  Google Scholar 

  • Beauchamp, M. R. (2016). Disentangling motivation from self-efficacy: Implications for measurement, theory-development, and intervention. Health Psychology Review, 10, 129–132. doi:10.1080/17437199.2016.1162666.

    Article  Google Scholar 

  • Beauchamp, M. R., Bray, S. R., Eys, M. A., & Carron, A. V. (2002). Role ambiguity, role efficacy, and role performance: Multidimensional and mediational relationships within interdependent sport teams. Group Dynamics: Theory, Research, and Practice, 6, 229–242. doi:10.1037//1089-2699.6.3.229.

    Article  Google Scholar 

  • Beauchamp, M. R., Barling, J., Li, Z., Morton, K. L., Keith, S. E., & Zumbo, B. D. (2010). Development and psychometric properties of the Transformational Teaching Questionnaire. Journal of Health Psychology, 15, 1123–1134. doi:10.1177/1359105310364175.

    Article  Google Scholar 

  • Blanton, H., Jaccard, J., & Burrows, C. N. (2015a). Implications of the implicit association Test D-transformation for psychological assessment. Assessment, 22, 429–440. doi:10.1177/1073191114551382.

    Article  Google Scholar 

  • Blanton, H., Jaccard, J., Strauts, E., Mitchell, G., & Tetlock, P. E. (2015b). Toward a meaningful metric of implicit prejudice. Journal of Applied Psychology, 100, 1468–1481. doi:10.1037/a0038379.

    Article  Google Scholar 

  • Brackett, M. A., & Mayer, J. D. (2003). Convergent, discriminant, and incremental validity of competing measures of emotional intelligence. Personality and Social Psychology Bulletin, 29, 1147–1158. doi:10.1177/0146167203254596.

    Article  Google Scholar 

  • Brackett, M. A., Mayer, J. D., & Warner, R. M. (2004). Emotional intelligence and its relation to everyday behaviour. Personality & Individual Differences, 36, 1387–1402. doi:10.1016/S0191-8869(03)00236-8.

    Article  Google Scholar 

  • Bryan, A., Robbins, R. N., Ruiz, M. S., & O’Neill, D. (2006). Effectiveness of an HIV prevention intervention in prison among African Americans, Hispanics, and Caucasians. Health Education and Behavior, 33, 154–177. doi:10.1177/1090198105277336.

    Article  Google Scholar 

  • Burton, A. (2015). Are we ready for direct-to-consumer genetic testing? The Lancet Neurology, 14, 138–139. doi:10.1016/S1474-4422(15)70003-7.

    Article  Google Scholar 

  • Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309–319.

    Article  Google Scholar 

  • Crombie, D., Lombard, C., & Noakes, T. (2009). Emotional intelligence scores predict team sports performance in a national cricket competition. International Journal of Sports Science and Coaching, 4, 209–224. doi:10.1260/174795409788549544.

    Article  Google Scholar 

  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.

    Article  Google Scholar 

  • De Houwer, J. (2006). What are implicit measures and why are we using them? In W. W. Reinout & A. W. Stacy (Eds.), Handbook of implicit cognition and addiction (pp. 11–28). Thousand Oaks, CA: Sage Publications. doi:10.4135/9781412976237.n2.

    Chapter  Google Scholar 

  • De Houwer, J., Teige-Mocigemba, S., Spruyt, A., & Moors, A. (2009). Implicit measures: A normative analysis and review. Psychological Bulletin, 135, 347–368. doi:10.1037/a0014211.

    Article  Google Scholar 

  • Diener, E. D., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75.

    Article  Google Scholar 

  • Downing, S. M. (2003). Validity: On the meaningful interpretation of assessment data. Medical Education, 37, 830–837. doi:10.1046/j.1365-2923.2003.01594.x.

    Article  Google Scholar 

  • Duncan, L., Latimer-Cheung, A., & Brackett, M. A. (2014). Emotional intelligence: A framework for examining emotions in sport and exercise groups. In M. R. Beauchamp & M. A. Eys (Eds.), Group dynamics in exercise and sport psychology (2nd ed., pp. 3–20). New York, NY: Routledge.

    Google Scholar 

  • Elfeddali, I., Bolman, C., Candel, M. J., Wiers, R. W., & De Vries, H. (2012). The role of self-efficacy, recovery self-efficacy, and preparatory planning in predicting short-term smoking relapse. British Journal of Health Psychology, 17, 185–201. doi:10.1111/j.2044-8287.2011.02032.x.

    Article  Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–251.

    Article  Google Scholar 

  • Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32, 221–233. doi:10.1037/h0057532.

    Article  Google Scholar 

  • French, D. P., Cooke, R., McLean, N., & Williams, M. (2007). What do people think about when they answer theory of planned behaviour questionnaires?: A ‘think aloud’ study. Journal of Health Psychology, 12, 672–687. doi:10.1177/1359105307078174.

    Article  Google Scholar 

  • Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2011). Investigating the substantive aspect of construct validity for the Satisfaction with Life Scale adapted for children: A focus on cognitive process. Social Indicators Research, 100, 37–60. doi:10.1007/s11205-010-9603-x.

    Article  Google Scholar 

  • Gadermann, A. M., Schonert-Reichl, K. A., & Zumbo, B. D. (2010). Investigating validity evidence of the satisfaction with Life Scale adapted for children. Social Indicators Research, 96, 229–247. doi:10.1007/s11205-009-9474-1.

    Article  Google Scholar 

  • Gawronski, B., & Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132, 692–731. doi:10.1037/0033-2909.132.5.692.

    Article  Google Scholar 

  • Gawronski, B., & De Houwer, J. (2014). Implicit measures in social and personality psychology. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (2nd ed., pp. 283–310). New York, NY: Cambridge University Press.

    Google Scholar 

  • Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464–1480. doi:10.1037/0022-3514.74.6.1464.

    Article  Google Scholar 

  • Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009). Understanding and using the implicit association test: III. Meta-analysis of predictive validity. Journal of Personality and Social Psychology, 97, 17–41. doi:10.1037/a0015575.

    Article  Google Scholar 

  • Gwaltney, C. J., Metrik, J., Kahler, C. W., & Shiffman, S. (2009). Self-efficacy and smoking cessation: A meta-analysis. Psychology of Addictive Behaviors, 23, 56–66. doi:10.1037/a0013529.

    Article  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. doi:10.1080/10705519909540118.

    Article  Google Scholar 

  • Hubley, A. M., & Zumbo, B. D. (1996). A dialectic on validity: Where we have been and where we are going. The Journal of General Psychology, 123, 207–215. doi:10.1080/00221309.1996.9921273.

    Article  Google Scholar 

  • Hubley, A. M., & Zumbo, B. D. (2011). Validity and the consequences of test interpretation and use. Social Indicators Research, 103, 219–230. doi:10.1007/s11205-011-9843-4.

    Article  Google Scholar 

  • Johnston, M., French, D. P., Bonetti, D., & Johnston, D. W. (2004). Assessment and measurement in health psychology. In S. Sutton, A. Baum, & M. Johnston (Eds.), The Sage handbook of health psychology (pp. 288–323). London, UK: Sage.

    Google Scholar 

  • Keatley, D., Clarke, D. D., & Hagger, M. S. (2012). The predictive validity of implicit measures of self-determined motivation across health-related behaviours. British Journal of Health Psychology, 18, 2–17. doi:10.1111/j.2044-8287.2011.02063.x.

    Article  Google Scholar 

  • Kirsch, I. (1995). Self-efficacy and outcome expectancy: A concluding commentary. In J. E. Maddux (Ed.), Self-efficacy, adaptation, and adjustment: Theory, research, and application (pp. 341–345). New York, NY: Plenum Press.

    Google Scholar 

  • Luszczynska, A., & Tryburcy, M. (2008). Effects of a self-efficacy intervention on exercise: The moderating role of diabetes and cardiovascular diseases. Applied Psychology, 57, 644–659. doi:10.1111/j.1464-0597.2008.00340.x.

    Article  Google Scholar 

  • Luszczynska, A., Tryburcy, M., & Schwarzer, R. (2007). Improving fruit and vegetable consumption: A self-efficacy intervention compared with a combined self-efficacy and planning intervention. Health Education Research, 22, 630–638. doi:10.1093/her/cyl133.

    Article  Google Scholar 

  • Marsh, H. W. (1997). The measurement of physical self-concept: A construct validation approach. In K. R. Fox (Ed.), The physical self: From motivation to well-being (pp. 27–58). Champaign, IL: Human Kinetics.

    Google Scholar 

  • Mayer, J. D., Roberts, R. D., & Barsade, S. G. (2008). Human abilities: Emotional intelligence. Annual Review of Psychology, 59, 507–536. doi:10.1146/annurev.psych.59.103006.093646.

    Article  Google Scholar 

  • Mayer, J. D., Salovey, P., & Caruso, D. R. (2002). MSCEIT user’s manual. Toronto, ON: Multi-Health Systems.

    Google Scholar 

  • Mayer, J. D., Salovey, P., & Caruso, D. R. (2004). Emotional intelligence: Theory, findings, and implications. Psychological Inquiry, 15, 197–215. doi:10.1207/s15327965pli1503_02.

    Article  Google Scholar 

  • Mayer, J. D., Salovey, P., & Caruso, D. R. (2008). Emotional intelligence: New ability or eclectic traits? American Psychologist, 63, 503–517. doi:10.1037/0003-066X.63.6.503.

    Article  Google Scholar 

  • Mayer, J. D., Salovey, P., Caruso, D. R., & Sitarenios, G. (2003). Measuring emotional intelligence with the MSCEIT V2.0. Emotion, 3, 97–105. doi:10.1037/1528-3542.3.1.97.

    Article  Google Scholar 

  • McAuley, E., & Blissmer, B. (2000). Self-efficacy determinants and consequences of physical activity. Exercise and Sport Sciences Reviews, 28, 85–88.

    Google Scholar 

  • Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66, 195–244. doi:10.2466/pr0.1990.66.1.195.

    Article  Google Scholar 

  • Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 12–103). New York, NY: Macmillan.

    Google Scholar 

  • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749. doi:10.1037/0003-066X.50.9.741.

    Article  Google Scholar 

  • Morton, K. L., Barling, J., Mâsse, L., Rhodes, R., Zumbo, B. D., & Beauchamp, M. R. (2011). The application of transformational leadership theory to parenting: Questionnaire development and implications for adolescent self-regulatory efficacy and life satisfaction. Journal of Sport and Exercise Psychology, 33, 688–709.

    Article  Google Scholar 

  • Noar, S. M., Benac, C. N., & Harris, M. S. (2007). Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychological Bulletin, 133, 673–693. doi:10.1037/0033-2909.133.4.673.

    Article  Google Scholar 

  • O’Keefe, D. J., & Jensen, J. D. (2008). Do loss-framed persuasive messages engender greater message processing than do gain-framed messages? A meta-analytic review. Communication Studies, 59, 51–67. doi:10.1080/10510970701849388.

    Article  Google Scholar 

  • O’Malley, D. A., & Latimer-Cheung, A. E. (2013). Gaining perspective: The effects of message frame on viewer attention to and recall of osteoporosis prevention print advertisements. Journal of Health Psychology, 18, 1400–1410. doi:10.1177/1359105312456323.

    Article  Google Scholar 

  • Oremus, M., Cosby, J. L., & Wolfson, C. (2005). A hybrid qualitative method for pretesting questionnaires: The example of a questionnaire to caregivers of Alzheimer disease patients. Research in Nursing Health, 28, 419–430. doi:10.1002/nur.20095.

    Article  Google Scholar 

  • Prince, S. A., Adamo, K. B., Hamel, M. E., Hardt, J., Gorber, S. C., & Tremblay, M. (2008). A comparison of direct versus self-report measures for assessing physical activity in adults: A systematic review. International Journal of Behavioral Nutrition and Physical Activity, 5, 56–70. doi:10.1080/02701367.2000.11082780.

    Article  Google Scholar 

  • Quoidbach, J., & Hansenne, M. (2009). The impact of trait emotional intelligence on nursing team performance and cohesiveness. Journal of Professional Nursing, 25, 23–29. doi:10.1016/j.profnurs.2007.12.002.

    Article  Google Scholar 

  • Rego, A., Godinho, L., McQueen, A., & Cunha, M. P. (2010). Emotional intelligence and caring behaviour in nursing. The Service Industries Journal, 30, 1419–1437. doi:10.1080/02642060802621486.

    Article  Google Scholar 

  • Rhodes, R. E., & Blanchard, C. M. (2007). What do confidence items measure in the physical activity domain? Journal of Applied Social Psychology, 37, 759–774. doi:10.1111/j.1559-1816.2007.00184.x.

    Article  Google Scholar 

  • Rhodes, R. E., & Courneya, K. S. (2003). Self-efficacy, controllability, and intention in the theory of planned behaviour: Measurement redundancy or causal independence? Psychology and Health, 18, 79–91. doi:10.1080/0887044031000080665.

    Article  Google Scholar 

  • Rhodes, R. E., & Courneya, K. S. (2004). Differentiating motivation and control in the theory of planned behaviour. Psychology, Health, and Medicine, 9, 205–215. doi:10.1080/13548500410001670726.

    Article  Google Scholar 

  • Saklofske, D. H., Austin, E. J., Galloway, J., & Davidson, K. (2007). Individual difference correlates of health-related behaviours: Preliminary evidence for links between emotional intelligence and coping. Personality and Individual Differences, 42, 491–502. doi:10.1016/j.paid.2006.08.006.

    Article  Google Scholar 

  • Sayles, J. N., Pettifor, A., Wong, M. D., MacPhail, C., Lee, S. J., Hendriksen, E., et al. (2006). Factors associated with self-efficacy for condom use and sexual negotiation among South African youth. Journal of Acquired Immune Deficiency Syndromes, 43, 226–233. doi:10.1097/01.qai. 0000230527.17459.5c.

    Article  Google Scholar 

  • Schutte, N. S., Malouff, J. M., Hall, L. E., Haggerty, D. J., Cooper, J. T., Golden, C. J., et al. (1998). Development and validation of a measure of emotional intelligence. Personality and Individual Differences, 25, 167–177. doi:10.1016/S0191-8869(98)00001-4.

    Article  Google Scholar 

  • Schutte, N. S., Malouff, J. M., Thorsteinsson, E. B., Bhullar, N., & Rooke, S. E. (2007). A meta-analytic investigation of the relationship between emotional intelligence and health. Personality and Individual Differences, 42, 921–933. doi:10.1016/j.paid.2006.09.003.

    Article  Google Scholar 

  • Schwartz, B. (2015). Why we work. New York, NY: Simon and Schuster.

    Google Scholar 

  • Smith, G. T. (2005). On construct validity: Issues of method and measurement. Psychological Assessment, 17, 396–408. doi:10.1037/1040-3590.17.4.396.

    Article  Google Scholar 

  • Strack, F., & Deutsch, R. (2004). Reflective and impulsive determinants of social behavior. Personality and Social Psychology Review, 8, 220–247. doi:10.1207/s15327957pspr0803_1.

    Article  Google Scholar 

  • Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Procedures and techniques for developing grounded theory. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Sylvester, B. D., Standage, M., Dowd, A. J., Martin, L. J., Sweet, S. N., & Beauchamp, M. R. (2014). Perceived variety, psychological needs satisfaction, and exercise-related well-being. Psychology and Health, 29, 1044–1061. doi:10.1080/08870446.2014.907900.

    Article  Google Scholar 

  • Vogt, D. S., King, D. W., & King, L. A. (2004). Focus groups in psychological assessment: Enhancing content validity by consulting members of the target population. Psychological Assessment, 16, 231–243. doi:10.1037/1040-3590.16.3.231.

    Article  Google Scholar 

  • Williams, D. M., & Rhodes, R. E. (2016). The confounded self-efficacy construct: Conceptual analysis and recommendations for future research. Health Psychology Review, 10, 113–128. doi:10.1080/17437199.17432014.17941998.

    Article  Google Scholar 

  • Williams, H. W. (2008). Characteristics that distinguish outstanding urban principals: Emotional intelligence, social intelligence and environmental adaptation. Journal of Management Development, 27, 36–54.

    Article  Google Scholar 

  • Willis, G. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage.

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Psychology of Exercise, Health, and Physical Activity Laboratory, School of Kinesiology, War Memorial Gym, The University of British Columbia, 122 – 6081 University Blvd., Vancouver, V6T 1Z1, BC, Canada

    Mark R. Beauchamp & Desmond McEwan

Authors
  1. Mark R. Beauchamp
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Desmond McEwan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mark R. Beauchamp .

Editor information

Editors and Affiliations

  1. Measurement, Evaluation, and Research Methodology (MERM) Program, Department of Educational and Counselling Psychology, and Special Education (ECPS), The University of British Columbia, Vancouver, British Columbia, Canada

    Bruno D. Zumbo

  2. Measurement, Evaluation, and Research Methodology (MERM) Program, Department of Educational and Counselling Psychology, and Special Education (ECPS), The University of British Columbia, Vancouver, British Columbia, Canada

    Anita M. Hubley

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Beauchamp, M.R., McEwan, D. (2017). Response Processes and Measurement Validity in Health Psychology. In: Zumbo, B., Hubley, A. (eds) Understanding and Investigating Response Processes in Validation Research. Social Indicators Research Series, vol 69. Springer, Cham. https://doi.org/10.1007/978-3-319-56129-5_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56129-5_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56128-8

  • Online ISBN: 978-3-319-56129-5

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics

Search

Navigation