A systematic review in public health synthesizes evidence on population-level interventions, health policy effectiveness, and determinants of health to inform decision-making at organizational, community, and governmental levels. Public health reviews differ from clinical systematic reviews because they evaluate complex interventions delivered across diverse settings, populations, and implementation contexts, requiring methodological approaches that go beyond standard Cochrane clinical trial synthesis.
Why Public Health Evidence Synthesis Demands Different Methods
The Medical Research Council (MRC) framework for complex interventions (Skivington et al., 2021) recognizes that public health programs involve multiple interacting components, operate across organizational levels, and produce outcomes shaped by context. A school-based obesity prevention program, for example, involves dietary education, physical activity components, parental engagement, and cafeteria policy changes, all operating simultaneously within specific socioeconomic and cultural environments.
This complexity means that the standard clinical question format often falls short. While the read about pico framework works well for drug trials, public health reviews frequently use PICOS (adding Setting) or SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type) to capture the full scope of the question. Our PICO/SPIDER framework generator supports both formats.
The Campbell Collaboration, the social science counterpart to Cochrane, maintains a library of systematic reviews on education, crime and justice, social welfare, and international development. Their methodological standards complement Cochrane's clinical focus and provide guidance specific to public health and social policy reviews.
Unlike clinical trials with well-defined endpoints, public health outcomes are often distal and diffuse. A tobacco control policy review might measure quit rates, initiation rates, secondhand smoke exposure, healthcare utilization, and economic productivity, each requiring different data sources and synthesis approaches.
Searching the Public Health Literature
Public health evidence is scattered across medical, social science, education, and policy databases. A comprehensive search strategy must cast a wider net than a typical clinical systematic review.
Core databases include PubMed/MEDLINE, Embase, and the Cochrane Library. But stopping here misses critical public health evidence found in CINAHL (nursing and allied health), PsycINFO (behavioral interventions), ERIC (education-based health programs), Social Science Citation Index, and Global Health (international public health, particularly low- and middle-income countries).
Grey literature is disproportionately important in public health reviews. Government reports, WHO technical documents, NGO evaluations, and conference proceedings often contain implementation evidence not published in peer-reviewed journals. Useful starting points are the WHO IRIS repository (iris.who.int), the World Health Organization's free full-text library of its technical publications back to 1948, with collections for each regional office; CDC Stacks (stacks.cdc.gov), the public repository of CDC guidelines, reports and journal articles; CDC WONDER for mortality, natality and other surveillance data; trial registries such as ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform for unpublished trials; and the websites of ministries of health and non-governmental organizations. OpenGrey, still named in many older protocols, is no longer a live database: Inist-CNRS stopped hosting it at the end of November 2020, and its records survive only as an archived dataset.
The search strategy development process for public health reviews requires balancing sensitivity (finding all relevant evidence) against the practical reality that broader searches generate thousands of records.
Handling Complex Interventions in Synthesis
Pooling results from complex public health interventions requires careful judgment about what is meaningfully combinable. The Cochrane Handbook (Chapter 12) provides guidance on synthesizing complex interventions, emphasizing the importance of developing a logic model before starting the review.
A logic model maps the hypothesized causal pathway from intervention components through mediators to outcomes. For a community-based diabetes prevention program, this might include: health literacy sessions (component) leading to dietary knowledge (mediator) leading to HbA1c reduction (outcome), with socioeconomic status and healthcare access as moderators.
Harvest plots and effect direction plots are visual synthesis tools particularly useful when meta-analysis is not feasible due to intervention heterogeneity. These methods, endorsed by the Cochrane Public Health Group, display the direction and magnitude of effects across studies without requiring standardized effect sizes.
When meta-analysis is appropriate, public health reviews frequently use random-effects models because between-study variation is expected and clinically meaningful. Meta-regression can explore whether intervention characteristics (duration, intensity, delivery mode) explain heterogeneity, and our practical forest plot generator visualizes these pooled estimates.
Equity-Focused Systematic Reviews: The PROGRESS-Plus Framework
Public health has a unique obligation to examine how interventions affect health equity across population subgroups. The Cochrane Equity Methods Group developed the PROGRESS-Plus framework to guide equity-sensitive reviews:
- Place of residence (urban/rural, country)
- Race/ethnicity/culture/language
- Occupation
- Gender/sex
- Religion
- Education
- Socioeconomic status
- Social capital
- Plus: age, disability, sexual orientation, and other characteristics
An equity-focused systematic review explicitly examines whether intervention effects differ across PROGRESS-Plus categories. This requires extracting disaggregated data from included studies, which is often incompletely reported. The PRISMA-Equity 2012 extension provides reporting guidance for these reviews.
Welch et al. (2012, PLoS One) examined 300 systematic reviews from one month of MEDLINE indexing: of the 224 that assessed intervention effectiveness, only 29 (about 13%) assessed effects on health equity through subgroup or targeted analyses, and seven of those reported their equity subgroup analyses in too little detail to judge credibility. That gap is why equity questions need to be written into the protocol rather than added at the end.
Qualitative and Mixed-Methods Evidence Synthesis
Public health decisions require understanding not just whether interventions work, but how and why they work in specific contexts. This demands synthesis of qualitative research alongside quantitative evidence.
GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative Research) is the qualitative equivalent of the read about grade framework. Developed by Lewin et al. (2018), it assesses confidence in qualitative findings based on four components: methodological limitations, coherence, adequacy of data, and relevance.
Thematic synthesis (Thomas and Harden, 2008) is the most commonly used method for synthesizing qualitative studies in public health reviews. It involves coding findings from included studies, developing descriptive themes, and generating analytical themes that go beyond what individual studies reported.
Mixed-methods systematic reviews integrate quantitative effectiveness evidence with qualitative process evidence. The JBI methodology provides a structured approach to convergent and sequential mixed-methods synthesis, increasingly required by organizations like the World Health Organization when developing clinical practice guidelines.
Looking for expert guidance on your public health evidence synthesis? Research Gold provides professional systematic review services experienced in complex intervention synthesis, mixed-methods reviews, and equity-focused analysis. request a free PROSPERO registration quote with details about your public health review.