Individual Participant Data Meta-Analysis: Complete Guide

What an Individual Participant Data meta-analysis offers that aggregate-data pooling cannot

An individual participant data meta-analysis collects the raw, line-level records of every participant in each included study and re-analyses them together rather than pooling published summary effects. The Cochrane Handbook describes this approach in Chapter 26 and treats it as the methodological reference standard when participant-level data are obtainable, particularly for randomised trials of an intervention with a continuous, binary, time-to-event, or repeated-measures outcome.

Aggregate-data meta-analysis is fast, transparent, and reproducible from public reports, but it inherits whatever choices the original authors made about exposure definitions, follow-up windows, missing-data handling, and covariate adjustment. A pooled analysis of individual participant data lets the review team apply one consistent analytic framework across every study, which usually reduces heterogeneity that originates from analytic divergence rather than true clinical variation.

Why review teams pursue Individual Participant Data even when aggregate data are available

The headline argument for individual participant data pooling is statistical power for subgroup and interaction analysis. Aggregate-data meta-regression can detect ecological associations across studies, but it cannot test whether a treatment effect varies across individuals within studies. Within-trial interaction testing requires participant-level data. When the research question is about effect modification by age, sex, baseline severity, biomarker status, or comorbidity, individual participant data pooling is the only design that protects against ecological bias.

Other practical reasons that drive a team toward individual participant data include:

• Time-to-event outcomes with study-specific follow-up windows, where aggregate hazard ratios cannot be reconstructed without participant-level censoring information.
• Outcome harmonisation when included trials measured the same construct with different scales (Hamilton Depression versus Beck Depression Inventory) and a common conversion is needed.
• Risk of bias from selective reporting at the outcome level, which individual participant data checks can detect by recomputing effects from raw data.
• Updating a network meta-analysis with patient-level covariates to adjust for transitivity violations.

The Cochrane individual participant data Methods Group has documented these gains and the trade-offs in their guidance on individual participant data meta-analyses of randomised trials, and Riley and colleagues' 2010 PLOS Medicine guidance remains the most-cited synthesis of when individual participant data is justified.

The decision rule: when is Individual Participant Data worth the cost

An individual participant data project consumes between 18 and 36 months of calendar time and substantially more researcher and statistical effort than a conventional aggregate-data meta-analysis. Funders increasingly require justification for the additional cost. A defensible individual participant data proposal should rest on at least one of the following criteria:

1. The primary question is about effect modification or subgroup variation, and aggregate-data subgroup tests have produced inconclusive or ecologically biased estimates.
2. The outcome is time-to-event with non-proportional hazards or differential follow-up across trials.
3. Existing aggregate-data syntheses disagree because of inconsistent outcome definitions or covariate adjustment, and harmonised re-analysis would resolve the discrepancy.
4. A clinically important subgroup is rare within any single trial but common across the pooled cohort, and within-trial estimates lack precision.
5. The therapeutic question has stalled at a clinically equipoise level and a definitive synthesis is needed before the next trial is designed.

If none of these conditions apply, an aggregate-data meta-analysis with sensitivity and meta-regression analyses is usually sufficient and substantially cheaper.

One-stage versus two-stage models

The two analytical frameworks for an individual participant data meta-analysis differ in whether participant-level data from all trials are analysed together or separately followed by pooling.

Two-stage models

Stage one fits a study-specific model to each trial separately, producing an effect estimate (log odds ratio, log hazard ratio, mean difference) and its standard error. Stage two pools those estimates using a standard random-effects meta-analysis model with DerSimonian-Laird or REML estimation of between-study variance. Two-stage models are the default in most published individual participant data reviews because they reproduce the familiar forest-plot output of an aggregate-data review and they handle clustering by study automatically.

The Burke et al. 2017 Statistics in Medicine paper showed that two-stage models give nearly identical inference to one-stage models for continuous outcomes when the within-trial sample size is adequate. They are also more practical when data sharing agreements require trial-level analyses to remain on the host institution's server.

One-stage models

A one-stage model fits a single hierarchical regression across all participant records, with study identifiers entered as random effects (random intercepts and, optionally, random treatment-effect slopes). For binary outcomes the typical specification is a generalised linear mixed model with a logit link and study-level random effects. For time-to-event outcomes a stratified Cox model or a frailty model with study as the frailty term is standard.

One-stage models are preferred when:

• The number of events per trial is small (sparse-data bias makes two-stage estimates unstable).
• Within-trial interaction terms need to be estimated efficiently (the one-stage framework permits a treatment-by-covariate term while keeping study-level confounding under random-intercept control).
• The team needs flexible non-linear modelling of continuous covariates using restricted cubic splines.

The Riley 2023 paper "Two-stage or not two-stage?" in Research Synthesis Methods is the most current guidance and recommends one-stage for sparse-data binary outcomes and two-stage as the default elsewhere.

Data acquisition: the bottleneck most teams underestimate

Securing individual participant data is the rate-limiting step of any individual participant data project. The workflow is:

1. Inventory candidate studies from a systematic search (the search itself follows PRISMA 2020 and is no different from a conventional review).
2. Contact corresponding authors with a structured request describing the planned analysis, the variables required, and the data-sharing infrastructure.
3. Negotiate a data transfer agreement with each contributing institution, often involving institutional review board approvals on both sides.
4. Receive and validate the data, recomputing the trial's published primary analysis from the raw file as an integrity check.
5. Harmonise variables across trials, mapping outcome scales, covariate definitions, and time units to a common analytical schema.

Empirical reports place the typical response rate from corresponding authors at between 50 percent and 80 percent of contacted teams, with refusal rates highest for industry-sponsored trials and trials older than 15 years. Review protocols should declare a sensitivity analysis comparing the IPD-only pooled estimate with a hybrid estimate that incorporates aggregate data from non-responding trials, since the two can diverge meaningfully when non-response is non-random.

Software for Individual Participant Data meta-analysis

The software ecosystem has matured substantially in the last decade. The main packages are:

• Stata ipdmetan for two-stage individual participant data pooling with forest-plot output and meta-regression hooks.
• Stata mvmeta for multivariate meta-analysis when outcomes are correlated.
• R metafor for two-stage random-effects models with REML and a wide range of moderator and meta-regression options.
• R ipdma and ipdmeta packages for one-stage hierarchical models including treatment-by-covariate interactions.
• R lme4 or glmmTMB for one-stage generalised linear mixed models, especially for binary and count outcomes.
• R survival with frailty terms or stratified Cox models for time-to-event one-stage analyses.
• WinBUGS, JAGS, or Stan for Bayesian one-stage models when prior information needs to be incorporated.

Reporting templates and replication code for the most-cited individual participant data methods papers are available through the Centre for Statistics in Medicine and through the Cochrane individual participant data Methods Group resource library.

Reporting under PRISMA-IPD

The PRISMA-IPD extension, published in JAMA in 2015, provides a 33-item checklist that supplements PRISMA 2020 with IPD-specific items. The most consequential additions are:

• A flow diagram showing the number of trials approached, the number that responded, the number that supplied individual participant data, and the participants contributed by each.
• A description of the data-checking procedures used to verify that the supplied individual participant data reproduces the trial's published primary analysis.
• A statement of how missing individual participant data trials were handled, including a sensitivity analysis comparing IPD-only and IPD-plus-aggregate estimates.
• An explicit reporting of within-trial interaction tests for any subgroup or effect-modification analysis, with separate within-trial and across-trial estimates.

Reviews that fail to report within-trial interaction estimates are vulnerable to ecological bias and have been re-analysed by independent groups in several published critiques.

Common pitfalls

The most frequent errors in published individual participant data reviews include:

• Treating individual participant data as a single-stage data set without accounting for clustering by study, which inflates type I error rates by an order of magnitude in some settings.
• Pooling within-trial and across-trial covariate effects in one regression term, which conflates effect modification with confounding.
• Selective inclusion of trials that supplied individual participant data without comparing characteristics with non-responding trials, biasing the pooled estimate toward the responder population.
• Reporting subgroup p-values without an interaction test, a problem the EQUATOR Network and several editorials have repeatedly flagged.
• Underpowered interaction analyses that are reported as "no evidence of effect modification" when the confidence interval is wide enough to include clinically important interactions.

When to commission an Individual Participant Data meta-analysis

An individual participant data meta-analysis is the right design when the clinical or policy question depends on within-individual variation, when the included trials used heterogeneous outcome definitions, or when an aggregate-data review has produced inconclusive or contested estimates. It is the wrong design when the question is purely about average treatment effect, when the trials used a single common outcome, or when the budget and timeline cannot absorb 18 months and a full statistical team. In those cases a conventional aggregate-data review with sensitivity analyses delivers most of the inferential value at a fraction of the cost.

For most thesis and journal-article timelines, an aggregate-data meta-analysis is the appropriate design. Individual participant data reviews are typically funded as multi-year collaborations and benefit from a methodologist with prior individual participant data experience leading the analytic plan from the protocol stage. For teams who need that statistical lead but cannot recruit one in-house, our PhD-led meta-analysis service and full data analysis service handle one-stage and two-stage individual participant data pooling end-to-end.