Association between medical academic genealogy and publication outcome: impact of unconscious bias on scientific objectivity
- 37 Downloads
Our previous studies suggest that the training history of an investigator, termed “medical academic genealogy”, influences the outcomes of that investigator’s research. Here, we use meta-analysis and quantitative statistical modeling to determine whether such effects contribute to systematic bias in published conclusions.
A total of 108 articles were identified through a comprehensive search of the high-grade glioma (HGG) surgical resection literature. Analysis was performed on the 70 articles with sufficient data for meta-analysis. Pooled estimates were generated for key academic genealogies. Monte Carlo simulations were performed to determine whether the effects attributed to genealogy alone can arise due to chance alone.
Meta-analysis of the HGG literature without consideration for academic medical genealogy revealed that gross total resection (GTR) was associated with a significant decrease in the odds ratio (OR) for the hazard of death after surgery for both anaplastic astrocytoma (AA) and glioblastoma (AA: log [OR] = − 0.04, 95% CI [− 0.07 to − 0.01]; glioblastoma log [OR] = − 0.36, 95% CI [− 0.44 to − 0.29]). For the glioblastoma literature, meta-analysis of articles contributed by members of a genealogy consisting of mostly radiation oncologists revealed no reduction in the hazard of death after GTR [log [OR] = − 0.16, 95% CI [− 0.41 to 0.09]. In contrast, meta-analysis of published articles contributed by members of a genealogy consisting of mostly neurosurgeons revealed that GTR was associated with a significant reduction in the hazard of death [log [OR] = − 0.29, 95% CI [− 0.40 to 0.18]. Monte Carlo simulation revealed that the observed discrepancy between the articles contributed by the members of these two genealogies was unlikely to arise by chance alone (p < 0.006).
Meta-analysis of articles contributed by authors belonging to the different medical academic genealogies yielded distinct and contradictory pooled point-estimates, suggesting that genealogy contributes to systematic bias in the published literature.
KeywordsMedical academic genealogy Scientific objectivity Meta-analysis Brain tumor
Compliance with ethical standards
For this type of study, formal consent is not required.
Conflict of interest
All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers’ bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements), or non-financial interest (such as personal or professional relationships, affiliations, knowledge, or beliefs) in the subject matter or materials discussed in this manuscript.
A formal approval by the institutional ethics committee was not required for this study since all articles, journals, and author data were collected from publicly available sources.
Ethical approval: This article does not contain any studies with animals performed by any of the authors.
- 1.Academic Genealogy Wiki (2014) Available at: http://phdtree.org/. Accessed 7 Oct 2015
- 2.Barr AH Jr (1936) Cubism and abstract art. Belknap Press, CambridgeGoogle Scholar
- 5.Carico C, Nuño M, Mukherjee D, Elramsisy A, Dantis J, Hu J, Rudnick J, Yu JS, Black KL, Bannykh SI, Patil CG (2012) Loss of PTEN is not associated with poor survival in newly diagnosed glioblastoma patients of the temozolomide era. PLoS One 7(3):e33684. https://doi.org/10.1371/journal.pone.0033684 CrossRefGoogle Scholar
- 6.Carley K (2003) Dynamic network analysis. In: Breiger R, Carley K, Pattison P (eds) Dynamic social network modeling and analysis: workshop summary and papers. National Academies Press, Washington, DC, pp 133–145Google Scholar
- 8.Chaichana KL, Martinez-Gutierrez JC, De la Garza-Ramos R, Weingart JD, Olivi A, Gallia GL, Lim M, Brem H, Quinones-Hinojosa A (2013) Factors associated with survival for patients with glioblastoma with poor pre-operative functional status. J Clin Neurosci 20(6):818–823. https://doi.org/10.1016/j.jocn.2012.07.016 CrossRefGoogle Scholar
- 9.Chaichana KL, Cabrera-Aldana EE, Jusue-Torres I, Wijesekera O, Olivi A, Rahman M, Quinones-Hinojosa A (2014) When gross total resection of a glioblastoma is possible, how much resection should be achieved? World Neurosurg 82(1–2):e257–e265. https://doi.org/10.1016/j.wneu.2014.01.019 CrossRefGoogle Scholar
- 10.Chaichana KL, Jusue-Torres I, Navarro-Ramirez R, Raza SM, Pascual-Gallego M, Ibrahim A, Hernandez-Hermann M, Gomez L, Ye X, Weingart JD, Olivi A, Blakeley J, Gallia GL, Lim M, Brem H, Quinones-Hinojosa A (2014) Establishing percent resection and residual volume thresholds affecting survival and recurrence for patients with newly diagnosed intracranial glioblastoma. Neuro-Oncology 16(1):113–122. https://doi.org/10.1093/neuonc/not137 CrossRefGoogle Scholar
- 11.Fogh SE, Andrews DW, Glass J, Curran W, Glass C, Champ C, Evans JJ, Hyslop T, Pequignot E, Downes B, Comber E, Maltenfort M, Dicker AP, Werner-Wasik M (2010) Hypofractionated stereotactic radiation therapy: an effective therapy for recurrent high-grade gliomas. J Clin Oncol 28(18):3048–3053. https://doi.org/10.1200/JCO.2009.25.6941 CrossRefGoogle Scholar
- 12.Gonda DD, Warnke P, Sanai N, Taich Z, Kasper EM, Chen CC (2013) The value of extended glioblastoma resection: Insights from randomized controlled trials. Surg Neurol Int 4. India. https://doi.org/10.4103/2152-7806.117173
- 15.Jackson A (2007) A labor of love: the mathematics genealogy project. North Am Math Soc 54:1002–1003Google Scholar
- 19.Kowalczuk A, Macdonald RL, Amidei C, Dohrmann G 3rd, Erickson RK, Hekmatpanah J, Krauss S, Krishnasamy S, Masters G, Mullan SF, Mundt AJ, Sweeney P, Vokes EE, Weir BK, Wollman RL (1997) Quantitative imaging study of extent of surgical resection and prognosis of malignant astrocytomas. Neurosurgery 41(5):1028–1036CrossRefGoogle Scholar
- 22.Mathematics Genealogy Project (2014) Available at: http://genealogy.math.ndsu.nodak.edu/. Accessed 7 Oct 2015
- 23.McGirt MJ, Chaichana KL, Gathinji M, Attenello FJ, Than K, Olivi A, Weingart JD, Brem H, Quiñones-Hinojosa AR (2009) Independent association of extent of resection with survival in patients with malignant brain astrocytoma. J Neurosurg 110(1):156–162. https://doi.org/10.3171/2008.4.17536 CrossRefGoogle Scholar
- 24.Oppenlander ME, Wolf AB, Snyder LA, Bina R, Wilson JR, Coons SW, Ashby LS, Brachman D, Nakaji P, Porter RW, Smith KA, Spetzler RF, Sanai N (2014) An extent of resection threshold for recurrent glioblastoma and its risk for neurological morbidity. J Neurosurg 120(4):846–853. https://doi.org/10.3171/2013.12.JNS13184 CrossRefGoogle Scholar
- 26.Patil CG, Nuño M, Elramsisy A, Mukherjee D, Carico C, Dantis J, Hu J, Yu JS, Fan X, Black KL, Bannykh SI (2013) High levels of phosphorylated MAP kinase are associated with poor survival among patients with glioblastoma during the temozolomide era. Neuro-Oncology 15(1):104–111. https://doi.org/10.1093/neuonc/nos272 CrossRefGoogle Scholar
- 27.Piano Genealogy Database (2015) http://www.pianogenealogy.com.au/. Accessed 5 May 2015
- 28.R Core Team (2014) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org/. Accessed May 2018
- 29.Ramakrishna R, Barber J, Kennedy G, Rizvi A, Goodkin R, Winn RH, Ojemann GA, Berger MS, Spence AM, Rostomily RC (2010) Imaging features of invasion and preoperative and postoperative tumor burden in previously untreated glioblastoma: correlation with survival. Surg Neurol Int 1. https://doi.org/10.4103/2152-7806.68337
- 34.Scharp K (2014) History of Western PhilosophyGoogle Scholar
- 35.Scott J (2000) Social network analysis: a handbook, 2nd edn. Sage, LondonGoogle Scholar
- 38.The Academic Family Tree (2014) Available at: http://academictree.org/. Accessed 7 Oct 2015