Advertisement

European Radiology

, Volume 29, Issue 2, pp 517–526 | Cite as

Epidemiology of systematic reviews in imaging journals: evaluation of publication trends and sustainability?

  • M. Alabousi
  • A. Alabousi
  • T. A. McGrath
  • K. D. Cobey
  • B. Budhram
  • R. A. Frank
  • F. Nguyen
  • J. P. Salameh
  • A. Dehmoobad Sharifabadi
  • M. D. F. McInnesEmail author
Experimental
  • 167 Downloads

Abstract

Purpose

To evaluate the epidemiology of systematic reviews (SRs) published in imaging journals.

Methods

A MEDLINE search identified SRs published in imaging journals from 1 January 2000–31 December 2016. Articles retrieved were screened against inclusion criteria. Demographic and methodological characteristics were extracted from studies. Temporal trends were evaluated using linear regression and Pearson’s correlation coefficients.

Results

921 SRs were included that reported on 27,435 primary studies, 85,276,484 patients and were cited 26,961 times. The SR publication rate increased 23-fold (r=0.92, p<0.001) while the proportion of SRs to non-SRs increased 13-fold (r = 0.94, p<0.001) from 2000 (0.10%) to 2016 (1.33%). Diagnostic test accuracy (DTA) SRs were most frequent (46.5%) followed by therapeutic SRs (16.6%). Most SRs did not report funding status (54.2%). The median author team size was five; this increased over time (r=0.20, p<0.001). Of the studies, 67.3% included an imaging specialist co-author; this decreased over time (r=-0.57, p=0.017). Most SRs included a meta-analysis (69.6%). Journal impact factor positively correlated with SR publication rates (r=0.54, p<0.001). Magnetic resonance imaging (MRI) and ‘vascular and interventional radiology’ were the most frequently studied imaging modality and subspecialty, respectively. The USA, UK, China, Netherlands and Canada were the top five publishing countries.

Conclusions

The SR publication rate is increasing rapidly compared with the rate of growth of non-SRs; however, they still make up just over 1% of all studies. Authors, reviewers and editors should be aware of methodological and reporting standards specific to imaging systematic reviews including those for DTA and individual patient data.

Key Points

• Systematic review publication rate has increased 23-fold from 2000–2016.

• The proportion of systematic reviews to non-systematic reviews has increased 13-fold.

• The USA, UK and China are the most frequent published countries; those from the USA and China are increasing the most rapidly.

Keywords

Meta-analysis Epidemiology/methods and epidemiology/trends Publications/trends Research design/trends Diagnostic imaging/trends 

Abbreviations

DTA

Diagnostic test accuracy

IPD

Individual participant data

IQR

Interquartile range

JIF

Journal impact factor

PRISMA

Preferred Reporting Items for Systematic reviews and Meta-Analyses

Q1

First quartile (25th percentile)

Q3

Third quartile (75th percentile)

SR

Systematic review

Notes

Funding

University of Ottawa Department of Radiology Research Stipend Program

Compliance with ethical standards

Guarantor

The scientific guarantor of this publication is Matthew McInnes

Conflict of interest

The authors of this article declare no relationships with any companies whose products or services may be related to the subject matter of the article.

Statistics and biometry

One of the authors has significant statistical expertise (Dr McInnes).

Informed consent

Written informed consent was not required for this study because this study was an evaluation of published literature.

Ethical approval

Institutional Review Board approval was not required because this study was an evaluation of published literature.

Methodology

• retrospective

• cross sectional study

• multicenter study

Supplementary material

330_2018_5567_MOESM1_ESM.docx (195 kb)
ESM 1 (DOCX 195 kb)
330_2018_5567_MOESM2_ESM.xlsx (115 kb)
ESM 2 (XLSX 114 kb)

References

  1. 1.
    Murad MH, Montori VM (2013) Synthesizing evidence: shifting the focus from individual studies to the body of evidence. JAMA 309(21):2217–2218CrossRefGoogle Scholar
  2. 2.
    Page MJ, Shamseer L, Altman DG et al (2016) Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLoS Med 13(5):e1002028CrossRefGoogle Scholar
  3. 3.
    Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG (2007) Epidemiology and reporting characteristics of systematic reviews. PLoS Med 4(3):e78CrossRefGoogle Scholar
  4. 4.
    Ioannidis JP (2016) The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses. Milbank Q 94(3):485–514.5CrossRefGoogle Scholar
  5. 5.
    Berkman ND, Lohr KN, Ansari MT et al (2015) Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol 68(11):1312–1324CrossRefGoogle Scholar
  6. 6.
    Guyatt GH, Sackett DL, Sinclair JC, Hayward R, Cook DJ, Cook RJ (1995) Users' guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. JAMA 274(22):1800–1804CrossRefGoogle Scholar
  7. 7.
    Lundberg GD (2016) Who Do You Trust? MedScape, New York. Available via https://www.medscape.com/viewarticle/871378. Accessed 15 Dec 2016
  8. 8.
    Bastian H, Glasziou P, Chalmers I (2010) Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med 7(9):e1000326CrossRefGoogle Scholar
  9. 9.
    Ioannidis JP, Greenland S, Hlatky MA et al (2014) Increasing value and reducing waste in research design, conduct, and analysis. Lancet 383(9912):166–175CrossRefGoogle Scholar
  10. 10.
    Moher D, Glasziou P, Chalmers I et al (2016) Increasing value and reducing waste in biomedical research: who's listening? Lancet 387(10027):1573–1586CrossRefGoogle Scholar
  11. 11.
    Tunis AS, McInnes MD, Hanna R, Esmail K (2013) Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology 269(2):413–426CrossRefGoogle Scholar
  12. 12.
    McGrath TA, McInnes MD, Korevaar DA, Bossuyt PM (2016) Meta-Analyses of Diagnostic Accuracy in Imaging Journals: Analysis of Pooling Techniques and Their Effect on Summary Estimates of Diagnostic Accuracy. Radiology 281(1):78–85CrossRefGoogle Scholar
  13. 13.
    Moher D, Liberati A, Tetzlaff J, Altman DG, Group P (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6(7):e1000097CrossRefGoogle Scholar
  14. 14.
    Higgins J, Green S (2011) Cochrane handbook for systematic reviews of interventions. The Cochrane Collaboration, London. Available via http://training.cochrane.org/handbook. Accessed 10 Dec 2016
  15. 15.
    McInnes MDF, Moher D, Thombs BD et al (2018) Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA 319(4):388–396CrossRefGoogle Scholar
  16. 16.
    Issa Y, Kempeneers MA, van Santvoort HC, Bollen TL, Bipat S, Boermeester MA (2017) Diagnostic performance of imaging modalities in chronic pancreatitis: a systematic review and meta-analysis. Eur Radiol 27(9):3820–3844CrossRefGoogle Scholar
  17. 17.
    Sevcenco S, Spick C, Helbich TH et al (2017) Malignancy rates and diagnostic performance of the Bosniak classification for the diagnosis of cystic renal lesions in computed tomography - a systematic review and meta-analysis. Eur Radiol 27(6):2239–2247CrossRefGoogle Scholar
  18. 18.
    Porté F, Uppara M, Malietzis G et al (2017) CT colonography for surveillance of patients with colorectal cancer: Systematic review and meta-analysis of diagnostic efficacy. Eur Radiol 27(1):51–60CrossRefGoogle Scholar
  19. 19.
    Connolly MJ, McInnes MDF, El-Khodary M, McGrath TA, Schieda N (2017) Diagnostic accuracy of virtual non-contrast enhanced dual-energy CT for diagnosis of adrenal adenoma: A systematic review and meta-analysis. Eur Radiol 27(10):4324–4335CrossRefGoogle Scholar
  20. 20.
    Lee SY, Kim HJ, Shin YR, Park HJ, Lee YG, Oh SJ (2017) Prognostic significance of focal lesions and diffuse infiltration on MRI for multiple myeloma: a meta-analysis. Eur Radiol 27(6):2333–2347CrossRefGoogle Scholar
  21. 21.
    Stewart LA, Clarke M, Rovers M et al (2015) Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement. JAMA 313(16):1657–1665CrossRefGoogle Scholar
  22. 22.
    Hutton B, Salanti G, Caldwell DM et al (2015) The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 162(11):777–784CrossRefGoogle Scholar
  23. 23.
    Shojania KG, Bero LA (2001) Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract 4(4):157–162Google Scholar
  24. 24.
    Web of Science (2017). Clarivate Analytics, Boston. Available via https://login.webofknowledge.com. Accessed 5 Jan 2017
  25. 25.
    Sardanelli F, Bashir H, Berzaczy D et al (2014) The role of imaging specialists as authors of systematic reviews on diagnostic and interventional imaging and its impact on scientific quality: report from the EuroAIM Evidence-based Radiology Working Group. Radiology 272(2):533–540CrossRefGoogle Scholar
  26. 26.
    Dang W, McInnes MD, Kielar AZ, Hong J (2015) A Comprehensive Analysis of Authorship in Radiology Journals. PLoS One 10(9):e0139005CrossRefGoogle Scholar
  27. 27.
    Zou KH, Tuncali K, Silverman SG (2003) Correlation and simple linear regression. Radiology 227(3):617–622CrossRefGoogle Scholar
  28. 28.
    Riley RD, Lambert PC, Abo-Zaid G (2010) Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ 340:c221CrossRefGoogle Scholar
  29. 29.
    Ioannidis JP, Chang CQ, Lam TK, Schully SD, Khoury MJ (2013) The geometric increase in meta-analyses from China in the genomic era. PLoS One 8(6):e65602CrossRefGoogle Scholar
  30. 30.
    van der Pol CB, McInnes MD, Petrcich W, Tunis AS, Hanna R (2015) Is quality and completeness of reporting of systematic reviews and meta-analyses published in high impact radiology journals associated with citation rates? PLoS One 10(3):e0119892CrossRefGoogle Scholar
  31. 31.
    Fleming PS, Koletsi D, Seehra J, Pandis N (2014) Systematic reviews published in higher impact clinical journals were of higher quality. J Clin Epidemiol 67(7):754–759CrossRefGoogle Scholar
  32. 32.
    Brinjikji W, Klunder A, Kallmes DF (2013) The 100 most-cited articles in the imaging literature. Radiology 269(1):272–276CrossRefGoogle Scholar
  33. 33.
    Pagni M, Khan NR, Cohen HL, Choudhri AF (2014) Highly cited works in radiology: the top 100 cited articles in radiologic journals. Acad Radiol 21(8):1056–1066CrossRefGoogle Scholar
  34. 34.
    Yoon DY, Yun EJ, Ku YJ et al (2013) Citation classics in radiology journals: the 100 top-cited articles, 1945-2012. AJR Am J Roentgenol 201(3):471–481CrossRefGoogle Scholar
  35. 35.
    McInnes MD, Bossuyt PM (2015) Pitfalls of Systematic Reviews and Meta-Analyses in Imaging Research. Radiology 277(1):13–21CrossRefGoogle Scholar
  36. 36.
    Glasziou P, Altman DG, Bossuyt P et al (2014) Reducing waste from incomplete or unusable reports of biomedical research. Lancet 383(9913):267–276CrossRefGoogle Scholar
  37. 37.
    Siontis KC, Hernandez-Boussard T, Ioannidis JP (2013) Overlapping meta-analyses on the same topic: survey of published studies. BMJ 347:f4501CrossRefGoogle Scholar
  38. 38.
    PRISMA: Transparent Reporting of Systematic Reviews and Meta-analyses (2015) Preferred Reporting Items for a Systematic Review and Meta-analysis, Ottawa. Available via http://www.prisma-statement.org. Accessed 13 Feb 2018
  39. 39.
    EQUATOR Network: Enhancing the Quality and Transparency of Health Research (2018) EQUATOR Network, Oxford. Available via http://www.equator-network.org. Accessed 13 Feb 2018
  40. 40.
    Cochrane: Trusted evidence. Informed decisions. Better health. (2018) Cochrane, London. Available via http://www.cochrane.org. Accessed 13 Feb 2018.

Copyright information

© European Society of Radiology 2018

Authors and Affiliations

  • M. Alabousi
    • 1
  • A. Alabousi
    • 1
    • 2
  • T. A. McGrath
    • 3
  • K. D. Cobey
    • 4
    • 5
    • 6
    • 7
  • B. Budhram
    • 8
  • R. A. Frank
    • 3
  • F. Nguyen
    • 3
  • J. P. Salameh
    • 5
  • A. Dehmoobad Sharifabadi
    • 3
  • M. D. F. McInnes
    • 9
    Email author return OK on get
  1. 1.Department of RadiologyMcMaster UniversityHamiltonCanada
  2. 2.St Joseph’s HealthcareHamiltonCanada
  3. 3.Faculty of MedicineUniversity of OttawaOttawaCanada
  4. 4.Centre for Journalology, Clinical Epidemiology Program, The Ottawa Hospital Research InstituteOttawaCanada
  5. 5.School of Epidemiology and Public HealthUniversity of OttawaOttawaCanada
  6. 6.Department of MedicineUniversity of OttawaOttawaCanada
  7. 7.Department of Psychology, School of Natural SciencesUniversity of StirlingStirlingUK
  8. 8.Faculty of MedicineUniversity of OttawaOttawaCanada
  9. 9.University of Ottawa Department of Radiology, Clinical Epidemiology Program, Ottawa Hospital Research InstituteOttawaCanada

Personalised recommendations