Epidemiology and reporting characteristics of systematic reviews: 2014 update


RO 4.6


Rapid oral session 4: Quality of reporting


Sunday 4 October 2015 - 11:00 to 12:30


All authors in correct order:

Page MJ1, Shamseer L2, Altman DG3, Tetzlaff J4, Sampson M5, Tricco AC6, Catalá-López F7, Li L8, Reid E9, Sarkis-Onofre R10, Moher D2
1 School of Public Health and Preventive Medicine, Monash University, Australia
2 Ottawa Hospital Research Institute and University of Ottawa, Canada
3 University of Oxford, United Kingdom
4 Ottawa Hospital Research Institute, Canada
5 Children’s Hospital of Eastern Ontario, Canada
6 Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Canada
7 Division of Pharmacoepidemiology and Pharmacovigilance, Spanish Medicines and Healthcare Products Agency (AEMPS), Spain
8 The First Clinical College of Lanzhou University, China
9 Department of Pharmacy, Vancouver General Hospital, Canada
10 Federal University of Pelotas, Brazil
Presenting author and contact person

Presenting author:

Matthew Page

Contact person:

Abstract text
Background: Moher et al [1] examined a November 2004 MEDLINE-indexed sample of 300 systematic reviews (SRs) and found that reporting quality was variable. The SR landscape has changed considerably in the subsequent decade, with the publication of a reporting guideline for SRs of randomised trials of health care interventions (PRISMA), methodological developments such as the Cochrane risk of bias tool, and the proliferation of new avenues to disseminate SRs. We considered it timely to evaluate a more recent cross-sectional sample.
Objective: To investigate the epidemiological and reporting characteristics of SRs.
Methods: We searched MEDLINE to identify potentially eligible SRs indexed in February 2014. Citations were screened using pre-specified eligibility criteria. We developed a standardised, pilot-tested data extraction form comprising all items used in [1], along with additional items to capture issues not previously examined. Example items include focus of the SR (e.g. therapeutic, diagnostic), number of included studies, and reporting of eligibility criteria, search strategy, and statistical analyses. Data in 300 SRs will be independently extracted by one of several reviewers, with a 10% random sample extracted in duplicate. We will compare characteristics of i) Cochrane versus non-Cochrane reviews, and ii) the current versus 2004 sample of SRs.
Results: We identified 698 SRs indexed in February 2014. This suggests an annual publication rate of approximately 8300 SRs (equivalent to 23 SRs per day), which is more than triple the estimated rate in 2004. Cochrane Reviews comprised only 14% of the sample. Reporting characteristics will be presented at the Colloquium.
Conclusion: This study will provide up-to-date data on the different types of SRs being published (e.g. therapeutic, diagnostic, prognostic) and the reporting quality of SRs. The findings will indicate where methodological and reporting guidance for SRs is most needed, and will inform the SR methodology research agenda.
1. Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Medicine 2007;4(3):e78.