A prediction interval in random-effects meta-analysis defines the range within which the true effect size in a future, similar study is expected to fall, with a specified probability (usually 95%). It accounts not just for sampling uncertainty in the pooled estimate but also for the genuine variability in true effects across settings, populations, and implementations.
Confidence intervals answer: "Where does the mean true effect lie?" Prediction intervals answer: "Where will the next true effect lie?" For anyone applying a meta-analysis finding to a new clinical or policy context, the prediction interval is the more relevant quantity.
Try our free Forest Plot Generator to compute and display prediction intervals alongside your pooled effect and confidence interval.
Why Confidence Intervals Alone Mislead Readers
The problem with reporting only a pooled effect and its confidence interval in the presence of heterogeneity is that the confidence interval describes only the precision of the average effect across your included studies. It shrinks as you add more studies, regardless of whether the true effects in those studies are converging or diverging.
Consider a pooled risk ratio of 1.35 with a 95% confidence interval of 1.18 to 1.55, p less than 0.001. But if tau-squared is 0.08 and the prediction interval runs from 0.82 to 2.21, the picture is entirely different. In some settings the intervention nearly halves risk; in others it appears harmful. The confidence interval would lead a clinician to apply the intervention universally. The prediction interval correctly signals that the effect is not reliably positive across contexts.
This is precisely the scenario that prompted major journals and the Cochrane Collaboration to recommend reporting prediction intervals whenever I-squared exceeds 0%.
The Mathematics Behind Prediction Intervals
Prediction intervals use the t-distribution with k minus 2 degrees of freedom, where k is the number of studies. The formula is:
PI = pooled estimate +/- t(k-2, 0.975) * sqrt(tau-squared + SE-squared)
The t-distribution accounts for the additional uncertainty introduced by estimating tau-squared from a limited number of studies. When k is small, the t-distribution has heavy tails, and prediction intervals are appropriately wide.
For k equals 5 studies, the t-critical value at alpha 0.05 two-tailed with 3 degrees of freedom is 3.18, compared to 1.96 for the normal distribution. This means prediction intervals from small meta-analyses are substantially wider than a naive normal-approximation calculation would suggest.
Our Effect Size Calculator can help you compute the input effect sizes and standard errors needed before constructing prediction intervals.
Interpreting Prediction Intervals in Practice
When the prediction interval excludes the null: The pooled effect is not only statistically significant on average but also expected to be significant in a new study. This is the strongest form of evidence from a random-effects synthesis.
When the prediction interval crosses the null despite a significant pooled effect: The average effect is positive and distinguishable from zero, but in some settings the true effect may be null or negative. The heterogeneity is large enough that you cannot predict with confidence that a new application will replicate the benefit. Subgroup analyses and meta-regression become the scientific priority.
When the prediction interval crosses the null and the pooled effect is also non-significant: The evidence simply does not support a consistent effect.
Pair your prediction interval interpretation with our Sensitivity Analysis Tool to check whether removing any single study collapses the heterogeneity and clarifies the prediction interval.
When Prediction Intervals Are Most Valuable
Generalizability assessments: When the question is "will it work for my patients in my hospital?", the prediction interval directly addresses the relevant uncertainty.
Guidelines and policy translation: Health technology assessment bodies are beginning to require prediction intervals alongside confidence intervals in submitted meta-analyses.
Informing future research design: A wide prediction interval that crosses the null is evidence for the value of additional research.
Reporting Prediction Intervals Correctly
A complete reporting statement: "The pooled odds ratio was 1.42 (95% CI: 1.18 to 1.71, p less than 0.001; tau-squared = 0.06, I-squared = 47%). The 95% prediction interval ranged from 0.91 to 2.21, indicating that while the average effect across included studies favors the intervention, the true effect in a future similar study could plausibly range from a modest benefit to a modest increase in odds."
Our free Forest Plot Generator displays prediction intervals as extended bars on the forest plot diagram.
Key Takeaways
- Prediction intervals define where a new future study's true effect is expected to fall, accounting for both sampling uncertainty and between-study heterogeneity.
- Confidence intervals describe only the precision of the pooled average; they narrow as k increases regardless of how inconsistent the true effects are across studies.
- The formula uses the t-distribution with k minus 2 degrees of freedom, producing appropriately wider intervals when k is small.
- A prediction interval that crosses the null despite a significant pooled effect is a finding, not a problem: it means the average effect is positive but not reliably replicated across all settings.
- Prediction intervals are most valuable for generalizability assessment, guideline development, and justifying future research.
- Always report prediction intervals alongside tau-squared and I-squared so readers can understand the source of the interval's width.
- Prediction intervals apply only to random-effects models; fixed-effects models do not support this concept.
FAQ
Why does the prediction interval use k minus 2 degrees of freedom?
The prediction interval requires estimation of two parameters: the pooled mean effect and tau-squared. Each estimated parameter consumes one degree of freedom, leaving k minus 2 for the t-distribution.
Can I have a prediction interval when I have only 2 studies?
With k equals 2, the degrees of freedom for the prediction interval are zero, making the t-distribution undefined and the prediction interval impossible to calculate meaningfully. Meta-analysis of 2 studies is generally discouraged.
Do prediction intervals account for publication bias?
No. Prediction intervals quantify the expected range of future true effects given the observed studies, assuming those studies are a representative sample. Publication bias assessment should accompany prediction interval reporting rather than replace it.
How does increasing the number of studies affect the prediction interval?
Adding studies reduces the standard error of the pooled estimate and improves the precision of tau-squared estimation. However, if the new studies reveal more heterogeneity, the prediction interval can actually widen as evidence accumulates.
Should prediction intervals always be reported, even when I-squared is near zero?
When I-squared is very low and tau-squared is near zero, the prediction interval will closely approximate the confidence interval. Reporting it is still good practice for transparency and because most reporting guidelines recommend prediction intervals whenever a random-effects model is used.
Need help with your systematic review or meta-analysis? Get a free quote from our team of PhD researchers.