A qualitative systematic review identifies, appraises, and synthesizes findings from qualitative research studies to answer questions about human experiences, perceptions, and behaviors. Unlike quantitative reviews that pool numerical data, qualitative reviews use synthesis methods such as thematic synthesis, meta-ethnography, and framework synthesis to produce new interpretive insights. This guide covers every stage, from search strategy and quality appraisal with CASP and JBI tools, to ENTREQ reporting and CERQual confidence assessment.
Qualitative systematic reviews synthesize textual findings from qualitative studies using methods such as thematic synthesis, meta-ethnography, framework synthesis, and meta-aggregation, each suited to different review questions and epistemological positions.
Quality appraisal uses the CASP Qualitative Checklist or JBI Critical Appraisal Checklist rather than quantitative risk-of-bias tools, focusing on methodological coherence, reflexivity, and the relationship between data and interpretations.
ENTREQ (21 items) guides reporting of the synthesis process, while PRISMA 2020 covers search strategy and study selection, and using both frameworks together ensures comprehensive transparent reporting.
CERQual assesses confidence in each synthesized finding across four components: methodological limitations, coherence, adequacy of data, and relevance, functioning as the qualitative equivalent of the GRADE framework.
Searching for qualitative studies requires broader database coverage (CINAHL, PsycINFO, ASSIA, Sociological Abstracts), supplementary citation tracking, and hand-searching because qualitative research is poorly and inconsistently indexed.
Thematic synthesis (Thomas and Harden, 2008) is the most accessible method for researchers new to qualitative evidence synthesis, while meta-ethnography (Noblit and Hare, 1988) produces the richest interpretive output but demands greater analytical skill.
A qualitative systematic review is a structured, transparent method for identifying, appraising, and synthesizing findings from qualitative research studies. While a quantitative systematic review pools numerical data through statistical meta-analysis, a qualitative systematic review integrates textual findings, participant quotes, and author interpretations to produce new conceptual insights about human experiences, perceptions, and behaviors.
Researchers use qualitative systematic reviews to answer "how" and "why" questions that numbers alone cannot address, such as how patients experience chronic pain management, why clinicians resist adopting new guidelines, or what barriers prevent medication adherence in adolescents. The Joanna Briggs Institute defines them as reviews that aggregate findings from primary qualitative studies using recognized synthesis methodologies, and the Cochrane Qualitative and Implementation Methods Group (Cochrane QIMG) maintains guidance on integrating qualitative evidence into Cochrane reviews.
Which synthesis method should you use? The short answer: thematic synthesis for reviews informing practice or policy, meta-ethnography for theory-building from 10 to 15 conceptually rich studies, framework synthesis when an existing theory already structures your question, and meta-aggregation for JBI-style reviews feeding clinical recommendations. The comparison table below unpacks each choice, then this guide covers appraisal, extraction, reporting, and CERQual confidence assessment.
How Qualitative Reviews Differ from Quantitative Reviews
The distinction between qualitative and quantitative systematic reviews extends far beyond the type of data they handle. The differences shape every stage of the review process, from question formulation to synthesis, reporting, and confidence assessment.
Frequently Asked Questions
6
A qualitative systematic review is the overarching term for any systematic review that synthesizes qualitative evidence. Meta-ethnography is one specific synthesis method used within that review. Other methods include thematic synthesis, framework synthesis, and meta-aggregation.
Yes. The Joanna Briggs Institute, Cochrane Qualitative and Implementation Methods Group, and Campbell Collaboration all provide guidance. These reviews follow the same principles of transparency and rigor as quantitative reviews while using synthesis methods designed for textual data.
There is no fixed minimum or maximum. Published qualitative systematic reviews typically include 5 to 30 studies. For meta-ethnography, around 10 to 15 studies is manageable. The priority is comprehensiveness of searching and quality of synthesis.
Use ENTREQ (Tong et al., 2012) for synthesis-specific reporting and PRISMA 2020 for structural elements including search strategy, study selection, and the flow diagram. Using both ensures comprehensive transparent reporting.
The CASP Qualitative Checklist and JBI Critical Appraisal Checklist are the most widely used tools. Neither produces a numerical score. Most methodologists recommend including all eligible studies and using sensitivity analysis to test whether findings change when lower-quality studies are excluded.
CERQual assesses confidence in qualitative review findings across four components: methodological limitations, coherence, adequacy of data, and relevance. It helps decision-makers distinguish between well-supported findings and those based on limited evidence, analogous to GRADE for quantitative reviews.
Share
Found this useful? Share it with your colleagues.
Need help with your evidence synthesis?
Our methodologists handle narrative synthesis, thematic analysis, umbrella reviews, and all forms of evidence synthesis, following established frameworks.
Complex Synthesis? Our PhD Team Specializes in Every Type.
Systematic reviews, narrative synthesis, umbrella reviews, and rapid reviews. We match the right methodology to your research question and deliver a publication-ready manuscript.
Our promise: Free rework on synthesis or GRADE assessment if reviewers push back.
4.9 / 5Quote in minutesPRISMA 2020 + GRADE certaintyPhD methodologistNDA available on request
Dr. Sarah Mitchell holds a PhD in Biostatistics from Johns Hopkins Bloomberg School of Public Health and has over 15 years of experience in systematic review methodology and meta-analysis. She has authored or co-authored 40+ peer-reviewed publications in journals including the Journal of Clinical Epidemiology, BMC Medical Research Methodology, and Research Synthesis Methods. A former Cochrane Review Group statistician and current editorial board member of Systematic Reviews, Dr. Mitchell has supervised 200+ evidence synthesis projects across clinical medicine, public health, and social sciences.
Complex Synthesis? Our PhD Team Specializes in Every Type.
Systematic reviews, narrative synthesis, umbrella reviews, and rapid reviews. We match the right methodology to your research question and deliver a publication-ready manuscript.
Quote in minutes. Pay only after you approve your quote. Unlimited revisions until your reviewers are satisfied. NDA available on request.
Research questions in quantitative reviews typically follow the PICO format (Population, Intervention, Comparison, Outcome). Qualitative reviews use broader frameworks such as PICo (Population, Interest, Context) or SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research type). These frameworks accommodate the exploratory, context-dependent nature of qualitative inquiry. A quantitative review might ask whether cognitive behavioral therapy reduces depression scores compared to standard care. A qualitative review might ask how patients with depression experience cognitive behavioral therapy and what factors influence their engagement with the treatment.
Search strategies also differ significantly. Qualitative studies are indexed inconsistently across databases. Many lack structured abstracts, and MeSH indexing for qualitative research is unreliable. This means that qualitative reviewers must search more databases (including CINAHL, PsycINFO, Sociological Abstracts, and ASSIA alongside PubMed and Embase), use broader search terms, and supplement database searching with citation tracking, hand-searching of key journals, and contact with authors. The concept of search saturation replaces the quantitative ideal of comprehensive retrieval.
Quality appraisal in quantitative reviews focuses on risk of bias using tools like the Cochrane Risk of Bias tool or the Newcastle-Ottawa Scale. Qualitative reviews use different instruments entirely, including the Critical Appraisal Skills Programme (CASP) Qualitative Checklist and the JBI Critical Appraisal Checklist for Qualitative Research. These tools evaluate methodological coherence, researcher reflexivity, ethical considerations, and the relationship between data and interpretations.
Synthesis is where the approaches diverge most dramatically. Quantitative reviews combine effect sizes using statistical methods. Qualitative reviews use interpretive or aggregative synthesis methods, including thematic synthesis, meta-ethnography, framework synthesis, and meta-aggregation, to generate findings that go beyond what any individual study reported. The result is not a pooled statistic but a new conceptual framework, a set of synthesized findings, or a line-of-argument that advances theoretical understanding.
Synthesis Methods: Choosing the Right Approach
Pick by review purpose: action vs theory vs intervention. Source: JBI Manual 2020; Booth et al., 2016.
Selecting the appropriate synthesis method is one of the most consequential decisions in a qualitative systematic review. Each method carries different epistemological assumptions, produces different types of output, and suits different review questions. The table below compares the four most widely used approaches.
Method
Originator
Epistemological Basis
Output Type
Best Suited For
Thematic synthesis
Thomas and Harden (2008)
Pragmatic, integrative
Analytical themes derived from descriptive themes
Reviews informing policy and practice; mixed-method reviews
Meta-ethnography
Noblit and Hare (1988)
Interpretive, constructivist
Line-of-argument synthesis; reciprocal and refutational translations
Reviews seeking new theoretical understanding; conceptually rich primary studies
Framework synthesis
Carroll et al. (2013)
Deductive, theory-driven
Findings mapped onto a pre-existing conceptual framework
Reviews testing or extending existing theories; reviews with a clear a priori framework
Meta-aggregation
Joanna Briggs Institute
Pragmatic, aggregative
Synthesized findings grouped under categories, with actionable recommendations
Thematic synthesis, developed by Thomas and Harden (2008), is the most commonly used method. It follows three stages: line-by-line coding of primary study findings, organization of codes into descriptive themes, and generation of analytical themes that go beyond the content of the original studies. Thematic synthesis is accessible to researchers who are new to qualitative evidence synthesis because it draws on familiar qualitative analysis techniques. It works well for reviews that aim to inform practice or policy decisions.
Meta-ethnography, developed by Noblit and Hare (1988), is the most interpretive approach. It involves seven phases: identifying the research interest, deciding what is relevant, reading the studies, determining how studies relate to each other (reciprocal translation, refutational translation, or line-of-argument synthesis), translating studies into one another, synthesizing translations, and expressing the synthesis. Meta-ethnography produces the richest conceptual output but demands significant interpretive skill and is best suited to reviews of 10 to 15 studies with thick descriptive data.
Framework synthesis uses an existing conceptual or theoretical framework as a scaffold for organizing and interpreting findings from primary studies. Reviewers code data deductively into the framework's categories while remaining open to new themes that do not fit. This method is particularly useful when a review aims to test or extend an existing theory, or when policymakers need findings organized around predetermined categories.
Meta-aggregation, the approach developed and promoted by the Joanna Briggs Institute, takes a more aggregative stance. It groups findings from primary studies into categories based on similarity of meaning, then produces synthesized findings with accompanying recommendations for practice graded by a ConQual assessment of confidence. Meta-aggregation preserves the original meaning of participants' experiences rather than reinterpreting them, making it the most conservative synthesis method.
Quality Appraisal: CASP, JBI, and the Role of Methodological Assessment
Critical appraisal of included studies is essential in any systematic review. In qualitative reviews, the purpose is not to assign a risk-of-bias score but to evaluate whether each study's methodology is coherent, transparent, and trustworthy. Two tools dominate qualitative critical appraisal.
The CASP Qualitative Checklist contains 10 questions organized around three broad issues: Are the results valid? What are the results? Will the results help locally? The checklist evaluates whether the research design was appropriate for the aims, whether the recruitment strategy was suitable, whether data collection addressed the research issue, whether the researcher-participant relationship was adequately considered, whether ethical issues were considered, whether the analysis was sufficiently rigorous, whether there is a clear statement of findings, and how valuable the research is. CASP does not produce a numerical score; instead, it prompts structured critical thinking about each study's strengths and limitations. You can complete and export the JBI qualitative checklist for every included study with our JBI critical appraisal tool.
The JBI Critical Appraisal Checklist for Qualitative Research contains 10 criteria that assess congruity between the stated philosophical perspective, methodology, research question, methods of data collection, data analysis, and interpretation of results. It also evaluates whether participants and their voices are adequately represented, whether the research is ethical, and whether conclusions flow from the analysis. You can apply this checklist using our free JBI critical appraisal tool.
Should studies be excluded based on quality? This is one of the most debated questions in qualitative evidence synthesis. Some methodologists argue that excluding studies based on quality assessment removes potentially important perspectives and introduces a form of bias. Others argue that including methodologically weak studies undermines the trustworthiness of the synthesis. The Cochrane QIMG recommends conducting sensitivity analysis by synthesizing findings with and without studies of lower methodological quality, then assessing whether the results change.
A practical approach is to include all studies that meet eligibility criteria, appraise them using CASP or JBI, present the appraisal results transparently in a table, and conduct sensitivity analysis to test the robustness of synthesized findings. This balances rigor with inclusiveness and allows readers to form their own judgments.
Struggling with critical appraisal, data extraction, or synthesis for your qualitative review? These are the most technically demanding stages of any qualitative systematic review. Research Gold's team includes experienced qualitative researchers who handle evidence synthesis projects from protocol to publication. get a personalized quote and tell us about your review.
Need help with your evidence synthesis?
Our methodologists handle narrative synthesis, thematic analysis, umbrella reviews, and all forms of evidence synthesis, following established frameworks.
Data extraction in qualitative systematic reviews differs fundamentally from quantitative extraction. Instead of extracting numerical outcomes, effect sizes, and confidence intervals, qualitative reviewers extract textual data: participant quotes, author interpretations, themes, concepts, and contextual information.
A well-designed extraction form captures two categories of information. The first is study-level metadata: authors, year, country, setting, population characteristics, sample size, research design, data collection method (interviews, focus groups, observation, document analysis), and analytical approach. The second is findings-level data: the actual qualitative findings that will enter the synthesis.
The definition of a "finding" depends on the synthesis method you are using. For thematic synthesis, findings are typically passages from the results or findings sections of primary studies that contain themes, subthemes, or descriptive codes. For meta-ethnography, findings include first-order constructs (participant quotes), second-order constructs (authors' interpretations), and the relationships between them. For meta-aggregation, findings are defined as a conclusion or theme supported by an illustration (a direct quotation from a participant) and accompanied by a credibility rating (unequivocal, credible, or unsupported).
Build your extraction form using our free data extraction template builder, which allows you to customize fields for qualitative, quantitative, or mixed-method reviews.
Key extraction decisions:
Extract from results sections only or from discussion sections as well? Most methodologists recommend extracting primarily from results or findings sections, where data is presented closest to participants' accounts. Discussion sections contain more author speculation and less data.
Who extracts? At least two reviewers should extract data independently for a subset of studies to establish consistency. Discrepancies should be resolved through discussion.
How to handle thick versus thin descriptions? Studies with rich, detailed findings contribute more to synthesis than studies with sparse descriptions. Document this variation during extraction so it can inform the confidence assessment later.
Contextual information matters. Record the setting, population characteristics, healthcare system, and cultural context. Qualitative findings are inherently context-dependent, and stripping context during extraction undermines the interpretive validity of the synthesis.
Reporting: ENTREQ, PRISMA 2020, and Transparent Documentation
Transparent reporting is critical for qualitative systematic reviews, and two complementary frameworks guide this process.
ENTREQ (Enhancing Transparency in Reporting the Synthesis of Qualitative Research), published by Tong et al. (2012), is the primary reporting guideline designed specifically for qualitative evidence synthesis. ENTREQ contains 21 items organized into five domains: introduction, methods and methodology, literature search and selection, appraisal, and synthesis of findings. Each item specifies what information reviewers should report to enable readers to assess the trustworthiness and transferability of the synthesis. For example, ENTREQ requires authors to state and justify the synthesis methodology, describe how studies were appraised, and explain how the synthesis was conducted, including any software used, the process of developing themes or translations, and how disagreements between reviewers were resolved.
PRISMA 2020 (Page et al., 2021) applies to all systematic reviews, including qualitative reviews, and governs the reporting of search strategy, study selection, and the overall review process. The PRISMA flow diagram is required regardless of whether your review is qualitative or quantitative. Generate yours using our free PRISMA flowchart generator.
How to use both frameworks together: PRISMA 2020 covers the structural and procedural elements of your review (search, selection, flow diagram), while ENTREQ covers the synthesis-specific elements (methodology justification, appraisal approach, synthesis process). Using both ensures comprehensive, transparent reporting. Many journals now require adherence to at least one reporting guideline as a condition of publication, and providing ENTREQ and PRISMA checklists as supplementary materials strengthens your submission.
Protocol registration for qualitative systematic reviews can be done on PROSPERO, which now accepts qualitative and mixed-method review protocols. A registered protocol demonstrates that your review was planned a priori and protects against post-hoc modifications to the review question, eligibility criteria, or synthesis approach.
Assessing Confidence in Qualitative Findings: The CERQual Approach
CERQual rates each finding across four domains. Source: Lewin et al., 2015, PLoS Med 12:e1001895.
In quantitative systematic reviews, the GRADE framework assesses the certainty of evidence for each outcome. The qualitative equivalent is CERQual (Confidence in the Evidence from Reviews of Qualitative Research), developed by Lewin et al. (2018). CERQual provides a systematic, transparent method for assessing how much confidence to place in individual review findings.
CERQual evaluates each synthesized finding across four components:
Methodological limitations: the extent to which there are problems with the design or conduct of the primary studies contributing to the finding, as assessed by the critical appraisal (using CASP or JBI)
Coherence: how clear and cogent the fit is between the data from primary studies and the review finding. High coherence means the finding is well supported by the underlying data with no major unexplained variations
Adequacy of data: the richness and quantity of data supporting the finding. A finding supported by thick, detailed data from multiple studies receives a higher adequacy assessment than one supported by thin data from a single study
Relevance: the extent to which the body of evidence from the primary studies is applicable to the context specified in the review question. Differences in population, setting, or phenomenon of interest between the primary studies and the review question reduce relevance
Each finding starts at high confidence and is downgraded based on concerns in any of the four components. The final assessment is expressed as high, moderate, low, or very low confidence. A CERQual Evidence Profile table presents the assessment for each finding, including the studies contributing to the finding, the assessment of each component, and the overall confidence level. This table is typically included in the results section or as a supplementary appendix.
CERQual serves a critical function: it helps decision-makers distinguish between well-supported qualitative findings that should influence practice and findings that are based on limited, methodologically weak, or contextually narrow evidence. Including a CERQual assessment significantly strengthens the credibility and utility of your qualitative systematic review.
Struggling with critical appraisal, data extraction, or synthesis for your qualitative review? Research Gold provides expert evidence synthesis support for qualitative and mixed-method reviews. Request a free quote.
Search Strategies for Qualitative Studies: Overcoming Indexing Challenges
Developing an effective search strategy for qualitative studies presents unique challenges that quantitative reviewers rarely encounter. Understanding these challenges is essential for conducting a comprehensive and reproducible search.
Database selection must be broader than for quantitative reviews. While PubMed and Embase are sufficient starting points for most quantitative reviews, qualitative studies are dispersed across disciplines and databases. A robust qualitative search should include CINAHL (nursing and allied health), PsycINFO (psychology and behavioral sciences), Sociological Abstracts (sociology), ASSIA (applied social sciences), Social Sciences Citation Index, and discipline-specific databases relevant to your topic. The Cochrane QIMG recommends searching at least five databases for qualitative reviews.
Search term challenges arise because qualitative research is poorly indexed. Many qualitative studies do not include "qualitative" in the title or abstract. MeSH terms like "qualitative research" were introduced relatively recently and are not applied retroactively. Methodological search filters for qualitative studies exist (such as the Cochrane QIMG qualitative filter and the ISSG Search Filter Resource), but they trade sensitivity for specificity and may miss relevant studies.
Practical search strategy recommendations:
Combine topic-specific terms with broad methodological filters that capture common qualitative designs (interview, focus group, ethnograph*, grounded theory, phenomenolog*, thematic analysis, content analysis, narrative, lived experience)
Search for specific data collection methods as well as methodology labels, since many qualitative studies describe their methods without labeling them
Use citation tracking (forward and backward) from included studies and from key conceptual papers in the field
Hand-search the tables of contents of three to five journals most likely to publish qualitative research on your topic
Contact corresponding authors of included studies to ask about additional relevant work
Search grey literature sources including dissertations (ProQuest Dissertations), conference proceedings, and organizational reports
The concept of search saturation is particularly relevant for qualitative reviews. Unlike quantitative reviews, where the goal is to identify every eligible study, qualitative reviews may reach a point where additional searching yields no new themes or concepts. Documenting when and how you determined saturation adds transparency to the reporting.
If you need hands-on coding support, our qualitative data analysis service covers framework analysis, thematic analysis, and NVivo or ATLAS.ti coding by trained qualitative researchers.
Common Challenges and Practical Solutions
Qualitative systematic reviews present methodological and practical challenges that can derail even experienced researchers. Understanding these challenges before you begin saves significant time and frustration.
Challenge 1: Overwhelming volume of textual data. Qualitative reviews can generate hundreds of pages of extracted findings. Without a systematic approach to managing this data, the synthesis becomes unwieldy. Solution: Use qualitative data analysis software such as NVivo, ATLAS.ti, or even a structured spreadsheet to organize extracted findings. Code systematically from the beginning rather than attempting to synthesize a large volume of uncoded text.
Challenge 2: Deciding what counts as a "finding." Primary qualitative studies present data in different ways. Some offer clearly labeled themes; others embed findings within narrative text. Solution: Define what constitutes a finding in your protocol, before extraction begins. For thematic synthesis, a finding is any theme, concept, or descriptive statement in the results section. For meta-aggregation, a finding must include an illustration (participant quote) and a judgment of credibility.
Challenge 3: Heterogeneity of included studies. Qualitative studies vary in theoretical perspective, methodology, setting, population, and analytical approach. This heterogeneity complicates synthesis. Solution: Rather than treating heterogeneity as a problem to eliminate, treat it as a source of insight. In meta-ethnography, differences between studies (refutational translations) are as informative as similarities (reciprocal translations). In thematic synthesis, variation across studies reveals the conditions under which themes apply or do not apply.
Challenge 4: Maintaining interpretive rigor. Qualitative synthesis is inherently interpretive. Reviewers bring their own perspectives, experiences, and assumptions to the process. Without safeguards, the synthesis may reflect the reviewers' preconceptions rather than the data. Solution: Maintain a reflexive journal documenting analytical decisions and their rationale. Use multiple reviewers for coding and theme development. Present preliminary findings to a broader team for critique. Report your epistemological position and its potential influence on the synthesis.
Challenge 5: Integrating qualitative and quantitative evidence. Many systematic reviews combine qualitative and quantitative evidence in a mixed-method synthesis. Integrating these fundamentally different types of evidence is methodologically complex. Solution: The JBI mixed-methods framework and the Evidence for Policy and Practice Information (EPPI) Centre approach both provide structured methods for integration. The most common approach is a segregated design, where qualitative and quantitative evidence are synthesized separately and then integrated in a matrix or narrative to explain how and why interventions work.
Qualitative systematic reviews require specialized skills in interpretive analysis, qualitative research methodology, and synthesis techniques. If you are conducting your first qualitative review or facing complex methodological decisions, professional guidance can help ensure your review meets publication standards. Research Gold offers comprehensive full-service systematic review and evidence synthesis support tailored to qualitative and mixed-method projects. Get a free quote today and tell us about your research question.
A rigorous, doctoral-level guide to conducting a meta-analysis: defining the question, extracting effect sizes and their variances, choosing a between-study variance estimator, pooling, and diagnosing heterogeneity and bias.
Meta-analysis in psychology pools the effect sizes from many studies into one reliable result. Learn the definition, real examples, and how researchers run one.
An annotated bibliography is a list of sources in which each citation is followed by a short annotation, usually 100 to 200 words, that summarises the source, evaluates its quality, and explains how it applies to your project. In nursing and health coursework it is written in APA 7 and often precedes an evidence-based practice project. This guide gives the three parts of an annotation, an APA 7 nursing example, how long each entry should be, and the mistakes to avoid.
