Details have been modified to protect client confidentiality. This case study represents a composite of common research scenarios encountered by Research Gold.
A systematic review major revision case study showing how a rejected manuscript was transformed into an accepted publication. Dr. B., a post-doctoral researcher in public health, had spent 11 months conducting a systematic review on community-based interventions for childhood obesity prevention. The manuscript was submitted to a Q1 public health journal and received a decision of major revision with reviewer comments that felt devastating.
The Reviewer Feedback That Changed Everything
The two peer reviewers and handling editor identified five critical methodological weaknesses:
Reviewer 1 concerns:
- "The protocol was not registered on PROSPERO or any other protocol registry. This is a fundamental requirement for systematic reviews submitted to this journal."
- "The search strategy appears to cover only PubMed and Google Scholar. A systematic review claiming comprehensive evidence retrieval must search at minimum three bibliographic databases."
- "Risk of bias assessment was conducted using a non-validated checklist. The journal requires domain-based tools such as RoB 2 for randomized trials."
Reviewer 2 concerns: 4. "The meta-analysis uses a fixed-effect model despite reporting I-squared of 78%. This level of heterogeneity requires a random-effects model." 5. "No sensitivity analyses, subgroup analyses, or publication bias assessment were conducted. The statistical analysis is insufficient for publication."
Dr. B. had invested nearly a year in this review and was now facing a 60-day revision window with comments that essentially required redoing the methodology from the foundation up.
Diagnosing the Root Causes
Dr. B.'s review had strong content expertise and a clinically important question, but the methodology reflected common gaps in evidence synthesis training.
Missing PROSPERO registration could not be fixed retrospectively for a review that had already completed screening and analysis. However, the protocol could be documented transparently, explaining that the review was conducted before the authors were aware of registration requirements, with all methods pre-specified in an internal protocol document.
Incomplete search strategy was the most fixable weakness. The original PubMed-only search had retrieved 1,200 records; expanding to Embase, CENTRAL, CINAHL, ERIC, and trial registries would capture evidence missed by the initial approach.
Non-validated quality tool meant the existing quality assessments were unusable. Complete re-assessment using validated tools was necessary.
Wrong statistical model required re-running all meta-analyses with the appropriate model, plus adding the missing sensitivity and subgroup analyses.
Week 1-2: Expanded Search and Screening
The first priority was expanding the search strategy to four additional databases. New search strategies were developed for Embase (with Emtree vocabulary), Cochrane CENTRAL, CINAHL, and ERIC (essential for school-based obesity interventions).
The expanded search retrieved an additional 3,200 unique records not captured by the original PubMed search. Screening these records against the eligibility criteria identified 8 additional studies meeting inclusion criteria, bringing the total from 18 to 26 included studies.
A new PRISMA flow chart generator tool was generated showing the complete screening process, including both the original and expanded search phases.