A Response to Cimpian and Timmer (2020): Limitations and Misrepresentation of “Mischievous Responders” in LGBT+ Health Research

This is a preview of subscription content, log in to check access.

References

  1. Allen, S. (2018). These teenager trolls are pretending to be LGBT and screwing up scientific studies. The Daily Beast. Retrieved from https://www.thedailybeast.com/these-teenage-trolls-are-pretending-to-be-lgbt-and-screwing-up-scientific-studies.

  2. Ashley, F. (2019). Science has always been ideological, you just don’t see it [Letter to the Editor]. Archives of Sexual Behavior,48(6), 1655–1657.

    Article  Google Scholar 

  3. Barchard, K. A., & Pace, L. A. (2011). Preventing human error: The impact of data entry methods on data accuracy and statistical results. Computers in Human Behavior,27(5), 1834–1839.

    Article  Google Scholar 

  4. Branstrom, R., Hatzenbuehler, M. L., & Pachankis, J. E. (2016). Sexual orientation disparities in physical health: Age and gender effects in a population-based study. Social Psychiatry and Psychiatric Epidemiology,51(2), 289–301.

    Article  Google Scholar 

  5. Brenner, P. S., & DeLamater, J. D. (2014). Social desirability bias in self-reports of physical activity: Is an exercise identity the culprit? Social Indicators Research,117(2), 489–504.

    Article  Google Scholar 

  6. Charlton, B. M., Hatzenbuehler, M. L., Jun, H. J., Sarda, V., Gordon, A. R., Raifman, J. R. G., & Austin, S. B. (2019). Structural stigma and sexual orientation-related reproductive health disparities in a longitudinal cohort study of female adolescents. Journal of Adolescence,74, 183–187.

    Article  Google Scholar 

  7. Charlton, B. M., Roberts, A. L., Rosario, M., Katz-Wise, S. L., Calzo, J. P., Spiegelman, D., & Austin, S. B. (2018). Teen pregnancy risk factors among young women of diverse sexual orientations. Pediatrics,141(4), e20172278. https://doi.org/10.1542/peds.2017-2278.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Cimpian, J. R., & Timmer, J. D. (2020). Mischievous responders and sexual minority youth survey data: A brief history, recent methodological advances, and implications for research and practice [Invited Commentary]. Archives of Sexual Behavior,49, 1097–1102.

    Article  Google Scholar 

  9. Cimpian, J. R., Timmer, J. D., Birkett, M. A., Marro, R. L., Turner, B. C., & Phillips, G. L., II. (2018). Bias from potentially mischievous responders on large-scale estimates of lesbian, gay, bisexual, or questioning (LGBQ)-heterosexual youth health disparities. American Journal of Public Health,108(S4), S258–S265.

    Article  Google Scholar 

  10. Clark, C. J., Borowsky, I. W., Salisbury, J., Usher, J., Spencer, R. A., Przedworski, J. M., & Everson-Rose, S. A. (2015). Disparities in long-term cardiovascular disease risk by sexual identity: The National Longitudinal Study of Adolescent to Adult Health. Preventive Medicine,76, 26–30.

    Article  Google Scholar 

  11. Cochran, S. D., & Mays, V. M. (2017). Advancing the LGBT health research agenda: Differential health trends within the lesbian, gay, and bisexual populations. American Journal of Public Health,107(4), 497–498.

    Article  Google Scholar 

  12. Corliss, H. L., Rosario, M., Wypij, D., Fisher, L. B., & Austin, S. B. (2008). Sexual orientation disparities in longitudinal alcohol use patterns among adolescents: Findings from the Growing Up Today Study. Archives of Pediatrics and Adolescent Medicine,162(11), 1071–1078.

    Article  Google Scholar 

  13. Curry, C., Felt, D., Beach, L.B., Ruprecht, M.M., Wang, X., & Phillips II, G. (2020). Lifetime asthma prevalence and correlates among U.S. youth by sexual identity and race/ethnicity, 2009–2017. American Journal of Public Health. https://doi.org/10.2105/AJPH.2020.305664.

  14. Duncan, D. T., Kanchi, R., Tantay, L., Hernandez, M., Letamendi, C., Chernov, C., & Thorpe, L. (2018). Disparities in sleep problems by sexual orientation among New York City adults: An analysis of the New York City Health and Nutrition Examination Survey, 2013–2014. Journal of Urban Health,95(6), 781–786.

    Article  Google Scholar 

  15. Egleston, B. L., Miller, S. M., & Meropol, N. J. (2011). The impact of misclassification due to survey response fatigue on estimation and identifiability of treatment effects. Statistics in Medicine,30(30), 3560–3572.

    Article  Google Scholar 

  16. Finneran, C., & Stephenson, R. (2014). Intimate partner violence, minority stress, and sexual risk-taking among U.S. men who have sex with men. Journal of Homosexuality,61(2), 288–306.

    Article  Google Scholar 

  17. Fish, J. N., & Russell, S. T. (2018). Have mischievous responders misidentified sexual minority youth disparities in the National Longitudinal Study of Adolescent to Adult Health? Archives of Sexual Behavior,47(4), 1053–1067.

    Article  Google Scholar 

  18. Fredriksen-Goldsen, K. I., Kim, H. J., & Barkan, S. E. (2012). Disability among lesbian, gay, and bisexual adults: Disparities in prevalence and risk. American Journal of Public Health,102(1), e16–e21. https://doi.org/10.2105/AJPH.2011.300379.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Goldberg, S. K., Reese, B. M., & Halpern, C. T. (2016). Teen pregnancy among sexual minority women: Results from the National Longitudinal Study of Adolescent to Adult Health. Journal of Adolescent Health,59(4), 429–437.

    Article  Google Scholar 

  20. Goodenow, C., Watson, R. J., Adjei, J., Homma, Y., & Saewyc, E. (2016). Sexual orientation trends and disparities in school bullying and violence-related experiences, 1999–2013. Psychology of Sexual Orientation and Gender Diversity,3(4), 386–396.

    Article  Google Scholar 

  21. Hafeez, H., Zeshan, M., Tahir, M. A., Jahan, N., & Naveed, S. (2017). Health care disparities among lesbian, gay, bisexual, and transgender youth: A literature review. Cureus,9(4), e1184. https://doi.org/10.7759/cureus.1184.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hahn, E. A., Cella, D., Dobrez, D. G., Weiss, B. D., Du, H. Y., Lai, J. S., & Garcia, S. F. (2007). The impact of literacy on health-related quality of life measurement and outcomes in cancer outpatients. Quality of Life Research,16(3), 495–507.

    Article  Google Scholar 

  23. Hatzenbuehler, M. L., McLaughlin, K. A., & Slopen, N. (2013). Sexual orientation disparities in cardiovascular biomarkers among young adults. American Journal of Preventive Medicine,44(6), 612–621.

    Article  Google Scholar 

  24. Jordan, B. (2018). Teens prank health surveys but researchers fight back. Futurity. Retrieved from https://www.futurity.org/mischievous-responders-teens-1922122/.

  25. Kalton, G., & Schuman, H. (1982). The effect of the question on survey responses: A review. Journal of the Royal Statistical Society,145, 42–73.

    Article  Google Scholar 

  26. Kaminska, O., McCutcheon, A. L., & Billiet, J. (2010). Satisficing among reluctant respondents in a cross-national context. Public Opinion Quarterly,74(5), 956–984.

    Article  Google Scholar 

  27. Karasic, D. H. (2016). Protecting transgender rights promotes transgender health. LGBT Health,3(4), 245–247.

    Article  Google Scholar 

  28. Marshal, M. P., Sucato, G., Stepp, S. D., Hipwell, A., Smith, H. A., Friedman, M. S., & Markovic, N. (2012). Substance use and mental health disparities among sexual minority girls: Results from the Pittsburgh Girls Study. Journal of Pediatric and Adolescent Gynecology,25(1), 15–18.

    Article  Google Scholar 

  29. McKirnan, D. J., Du Bois, S. N., Alvy, L. M., & Jones, K. (2013). Health care access and health behaviors among men who have sex with men: The cost of health disparities. Health Education & Behavior,40(1), 32–41.

    Article  Google Scholar 

  30. Nederhof, A. J. (1985). Methods of coping with social desirability bias: A review. European Journal of Social Psychology,15(3), 263–280.

    Article  Google Scholar 

  31. Porter, S., Whitcomb, M., & Weitzer, W. H. (2004). Multiple surveys of students and survey fatigue. New Directions for Institutional Research,121, 63–73.

    Article  Google Scholar 

  32. Randall, C. L., McNeil, D. W., Crout, R. J., Weyant, R. J., & Marazita, M. L. (2013). Collecting psychosocial self-report data in oral health research: Impact of literacy level and computerised administration. Social Science and Dentistry,2(2), 80–87.

    PubMed  PubMed Central  Google Scholar 

  33. Rasberry, C. N., Condron, D. S., Lesesne, C. A., Adkins, S. H., Sheremenko, G., & Kroupa, E. (2018). Associations between sexual risk-related behaviors and school-based education on HIV and condom use for adolescent sexual minority males and their non-sexual-minority peers. LGBT Health,5(1), 69–77.

    Article  Google Scholar 

  34. Robinson-Cimpian, J. P. (2014). Inaccurate estimation of disparities due to mischievous responders: Several suggestions to assess conclusions. Educational Researcher,43(4), 171–185.

    Article  Google Scholar 

  35. Rosario, M., Li, F., Wypij, D., Roberts, A. L., Corliss, H. L., Charlton, B. M., & Austin, S. B. (2016). Disparities by sexual orientation in frequent engagement in cancer-related risk behaviors: A 12-year follow-up. American Journal of Public Health,106(4), 698–706.

    Article  Google Scholar 

  36. Shumer, D. E., Harris, L. H., & Opipari, V. P. (2016). The effect of lesbian, gay, bisexual, and transgender-related legislation on children. Journal of Pediatrics,178, 5–6. https://doi.org/10.1016/j.jpeds.2016.08.028.

    Article  PubMed  Google Scholar 

  37. Smith, S. M., Roster, C. A., Golden, L. L., & Albaum, G. S. (2016). A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples. Journal of Business Research,69(8), 3139–3148.

    Article  Google Scholar 

  38. Sullivan, G., & Artino, A. R. (2017). How to create a bad survey instrument. Journal of Graduate Medical Education,9(3), 411–415.

    Article  Google Scholar 

  39. Trinh, M., Agenor, M., Austin, S. B., & Jackson, C. L. (2017). Health and healthcare disparities among U.S. women and men at the intersection of sexual orientation and race/ethnicity: A nationally representative cross sectional study. BMC Public Health, 17(1). https://doi.org/10.1186/s12889-017-4937-9.

  40. Van den Broeck, J., Cunningham, S. A., Eeckels, R., & Herbst, K. (2005). Data cleaning: Detecting, diagnosing, and editing data abnormalities. PLoS Medicine,2(10), 966–970.

    Google Scholar 

Download references

Funding

This work was supported by a grant from the National Institute on Alcohol Abuse and Alcoholism (R01 AA024409; PI: Phillips). This work was also supported, in part, by the University of Maryland Prevention Research Center cooperative agreement U48DP006382 from the Centers for Disease Control and Prevention (CDC). Any interpretations and opinions expressed herein are solely those of the authors and may not reflect those of the CDC. Fish also acknowledges support from the Eunice Kennedy Shriver National Center for Child Health and Human Development grant P2CHD041041, Maryland Population Research Center.

Author information

Affiliations

Authors

Contributions

All authors contributed to comment conception and design. GP, DF, and MMR drafted the initial manuscript, and VPP, JF, and MB critically reviewed and refined it. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Gregory Phillips II.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Human and Animal Rights Statement

Not applicable.

Informed Consent

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Phillips, G., Felt, D., Fish, J.N. et al. A Response to Cimpian and Timmer (2020): Limitations and Misrepresentation of “Mischievous Responders” in LGBT+ Health Research. Arch Sex Behav 49, 1409–1414 (2020). https://doi.org/10.1007/s10508-020-01746-3

Download citation