Effect sizes are the foundation of every meta-analysis. They translate the raw results from individual studies, which come in different formats, on different scales, and across different populations, into a common metric that can be pooled, compared, and interpreted across an entire body of evidence. Choosing the wrong effect size can invalidate your synthesis. Choosing the right one delivers clear, actionable conclusions that advance clinical knowledge and inform practice.
This guide covers every major effect size used in contemporary meta-analysis, explains when and why to use each one, provides worked decision frameworks, walks through conversion methods between metrics, and addresses the interpretation pitfalls that catch even experienced systematic reviewers.
Why Effect Sizes Are the Currency of Meta-Analysis
Individual studies report their results in a bewildering variety of formats: means and standard deviations, percentages and p-values, regression coefficients, hazard ratios, median survival times, or simple statements like "the intervention group improved significantly." A meta-analysis cannot work with this raw heterogeneity of reporting formats. It needs a standardised measure that captures the direction, magnitude, and precision of each study's finding in a common unit that allows direct comparison and mathematical pooling.
That standardised measure is the effect size, and it simultaneously answers the two most important questions in evidence synthesis. First, in which direction does the evidence point: does the intervention help, harm, or make no difference compared to the comparator? Second, how large is the effect: is it trivially small, clinically meaningful, or transformatively large? Without effect sizes, you cannot construct a forest plot, calculate a pooled estimate, assess heterogeneity, or conduct any of the subgroup or sensitivity analyses that give a meta-analysis its analytical power. They are not a statistical convenience; they are the fundamental unit of evidence synthesis.
The choice of effect size depends on three factors: the type of outcome being measured (continuous, dichotomous, time-to-event, or correlational), the measurement scales used across studies (identical or different instruments), and the study designs contributing data (experimental, observational, case-control). Getting this choice right at the protocol stage prevents painful analytical problems downstream.
Effect Sizes for Continuous Outcomes
When your outcome is measured on a continuous scale (blood pressure, pain scores, cognitive test performance, quality-of-life ratings), you have two primary options: the mean difference (MD) and the standardised mean difference (SMD). The choice between them depends entirely on whether your included studies all use the same measurement instrument.
Mean Difference (MD)
The mean difference is the simplest and most clinically interpretable effect size: the arithmetic difference between the intervention group mean and the control group mean, expressed in the original measurement units.
When to use the mean difference:
- All included studies measure the outcome on the same scale using the same instrument (e.g., systolic blood pressure in mmHg, Hamilton Depression Rating Scale score, forced expiratory volume in litres).
- The measurement scale has a clinically meaningful interpretation that your audience understands intuitively.
- You want readers to be able to directly translate your pooled result into clinical practice without requiring statistical training to interpret standardised units.
Advantages of the mean difference: Direct clinical interpretability is the primary strength. A pooled MD of -5.2 mmHg for blood pressure is immediately meaningful to clinicians, patients, and policymakers. No information is lost through standardisation, and the result requires no additional context for interpretation.
Limitations: The mean difference cannot be used when studies measure the same underlying construct using different instruments. You cannot meaningfully average a Beck Depression Inventory score change with a PHQ-9 score change in their original units, even though both measure depression severity.
Standardised Mean Difference (SMD)
The standardised mean difference expresses the difference between group means in standard deviation units rather than the original measurement units. This standardisation allows you to pool results from studies using different measurement instruments for the same underlying construct. The two versions you will encounter are Cohen's d and Hedges' g.
Cohen's d divides the mean difference by the pooled standard deviation of both groups:
d = (Mean_intervention - Mean_control) / SD_pooled
Hedges' g applies a small-sample correction factor to Cohen's d that adjusts for the upward bias present when sample sizes are small:
g = d × J, where J ≈ 1 - (3 / (4df - 1))
For studies with more than approximately 20 participants per group, Cohen's d and Hedges' g are nearly identical. For smaller samples, Hedges' g provides a less biased estimate and is the default choice in most meta-analysis software.
Pro Tip: Always use Hedges' g instead of Cohen's d as your default SMD. The correction factor adds negligible computational complexity (your software handles it automatically) but eliminates the systematic upward bias that Cohen's d exhibits with small samples. Since systematic reviews frequently include studies with modest sample sizes, defaulting to Hedges' g is a costless safeguard that improves accuracy. Every major meta-analysis software package (RevMan, Comprehensive Meta-Analysis, R metafor) offers Hedges' g as a standard option.
Interpreting Standardised Mean Differences
Cohen's widely cited benchmarks provide a starting framework for SMD interpretation, but they should always be contextualised within your specific clinical question:
| SMD Magnitude | Cohen's Label | Clinical Context Example |
|---|---|---|
| 0.2 | Small | A new antihypertensive lowers systolic BP by 0.2 SD, modest but potentially meaningful if the drug has a favourable safety profile |
| 0.5 | Medium | A psychotherapy intervention improves depression scores by 0.5 SD, a clearly noticeable clinical improvement |
| 0.8 | Large | A surgical intervention improves functional outcomes by 0.8 SD, a substantial, easily observable change |
| 1.2+ | Very large | Rare in clinical research; common in laboratory or educational interventions |
The critical caveat: these benchmarks are generic defaults, not clinical thresholds. An SMD of 0.2 in a life-threatening condition where no effective treatment exists may be profoundly meaningful. An SMD of 0.8 in a self-reported subjective outcome with known measurement bias may be less impressive than it appears. Always interpret SMDs in the context of the baseline severity, the patient population, the clinical significance threshold, and the precision of the estimate.
Choosing Between MD and SMD
Use the mean difference whenever possible because it preserves direct clinical interpretability. Reserve the standardised mean difference for situations where pooling requires standardisation across different instruments. If most of your included studies use the same measurement scale but a small number use different instruments, consider converting those outlier results to the common scale (if conversion formulas exist) rather than standardising everything. This preserves interpretability for the majority of your evidence.
Effect Sizes for Dichotomous Outcomes
When your outcome is binary (event or no event, response or no response, alive or dead), the three primary options are the risk ratio (RR), odds ratio (OR), and risk difference (RD). Each has distinct strengths, limitations, and appropriate use cases, and confusing them is one of the most common errors in meta-analysis reporting and interpretation.
Risk Ratio (Relative Risk)
The risk ratio compares the probability of the event in the intervention group to the probability in the control group:
RR = (Events_intervention / N_intervention) / (Events_control / N_control)
When to use the risk ratio: Cohort studies and randomised controlled trials where you can directly estimate the incidence of the event in both groups. The risk ratio is the preferred measure for most intervention meta-analyses because it is the most intuitive relative measure for clinicians and patients.
Interpretation framework:
| RR Value | Meaning | Clinical Example |
|---|---|---|
| RR = 1.0 | No difference between groups | The intervention has no effect on the outcome |
| RR = 0.75 | 25% relative risk reduction | The intervention reduces the event rate by one quarter |
| RR = 1.50 | 50% relative risk increase | The intervention increases the event rate by half |
| RR = 0.50 | 50% relative risk reduction | The intervention halves the event rate |
The risk ratio is bounded by zero on the lower end but has no upper bound, and its natural value of no effect is 1.0. It is typically log-transformed for meta-analytic pooling (because the log-RR has a more symmetric sampling distribution) and then back-transformed for reporting.
Odds Ratio
The odds ratio compares the odds (not the probability) of the event between groups:
OR = (Events_intervention / Non-events_intervention) / (Events_control / Non-events_control)
When to use the odds ratio: Case-control studies where you cannot directly estimate incidence, logistic regression models (which naturally output odds ratios), and situations involving rare events (below approximately 10% prevalence) where OR and RR converge to nearly identical values.
The critical caveat that every meta-analyst must understand: When baseline event rates exceed approximately 10%, odds ratios systematically overestimate the corresponding risk ratio. This divergence grows as the event rate increases. An OR of 3.0 with a 30% baseline risk corresponds to an RR of approximately 2.0, which represents a 50% overestimation of the relative risk. Never describe or interpret an odds ratio as though it were a risk ratio when the outcome is common. This single error is responsible for more misinterpretation in published meta-analyses than almost any other statistical mistake.
| Baseline Event Rate | Odds Ratio | Corresponding Risk Ratio | Overestimation |
|---|---|---|---|
| 5% (rare) | 2.0 | 1.95 | Minimal (~3%) |
| 10% | 2.0 | 1.82 | ~10% |
| 20% | 2.0 | 1.67 | ~20% |
| 30% | 2.0 | 1.54 | ~30% |
| 50% (common) | 2.0 | 1.33 | ~50% |
Risk Difference (Absolute Risk Reduction)
The risk difference is the absolute difference in event rates between groups:
RD = (Events_intervention / N_intervention) - (Events_control / N_control)
When to use the risk difference: When you need to communicate the absolute clinical impact of an intervention, calculate the Number Needed to Treat (NNT = 1 / |RD|), or help decision-makers understand how many events would be prevented per population treated. The risk difference contextualises relative effects within the baseline risk, which is essential for clinical decision-making.
Limitation for meta-analytic pooling: Risk differences tend to be more heterogeneous across studies than relative measures because they depend directly on the baseline event rate, which varies across populations and settings. For this reason, most meta-analyses use a relative measure (RR or OR) as the primary pooled estimate and present the risk difference or NNT as a supplementary measure for clinical interpretation.
Choosing Between RR, OR, and RD
For most meta-analyses of intervention effects, follow this decision framework:
- Primary measure: Use the risk ratio because it is intuitive, directly interpretable, and appropriate for cohort studies and RCTs.
- Case-control studies: Use the odds ratio because incidence cannot be estimated directly from case-control data.
- Supplementary measure: Report the risk difference and/or NNT alongside the primary relative measure to provide clinical context about absolute impact.
- Mixed study designs with rare events: Either RR or OR is acceptable since they converge when prevalence is below 10%.
- Mixed study designs with common events: Convert to a common metric using documented conversion formulas and present sensitivity analyses using unconverted values.
Pro Tip: Always check the direction of your effect sizes before pooling. A surprisingly common error in meta-analysis is accidentally combining effect sizes with reversed directions. If one study reports the mean difference as intervention minus control and another reports control minus intervention, your pooled estimate will be biased toward the null or even reversed. Create a consistent coding scheme during data extraction that defines the direction for all effect sizes, and verify the direction of every extracted value during data checking. This five-minute quality check has caught errors in countless published meta-analyses.
