Skip to Main Content

Systematic Reviews for Social Sciences

Mixed Methods Review

A  comprehensive syntheses of two or more types of data (e.g. quantitative and qualitative) are conducted and then aggregated into a final, combined synthesis

Mixed Methods Reviews are best designed for:

  • Multidisciplinary topics or topics with a body of literature that includes quantitative, qualitative, and mixed methods studies.
  • To determine not only the effects of interventions but also their appropriateness.
  • To identify research gaps.
  • To provide an explanation for possible heterogeneity between trials.
  • To answer multiple questions in one systematic review.

Limitations:

  • May result in a larger number of citations.
  • Requires more search time to create multiple searches for varying outcomes.
  • There are no universally adopted methods for conducting Mixed Methods Reviews.
  • Requires significant methodological skill.
  • Resource intensive--may take time to engage with the evidence and develop theory.
  • Not inherently reproducible or transparent because of the highly iterative nature of the interpretative process

(Source: M. Petticrew et al, 2013)

Outline of Stages

Timeframe: 12-18+ months.  Same as a systematic review or longer.  

Question: Addresses 2 or more review framework criteria, "Mixed methods reviews should pose a question that specifically requires the inclusion of two or more syntheses that are grounded in different approaches".  A priori review protocol is recommended.

Examples of and clearly articulated questions that may be posed by one mixed methods systematic review are:

1. What is the effectiveness of educational strategies associated with insulin pump therapy?

2. What is the appropriateness of educational strategies associated with insulin pump therapy

Sources and searches: Types of studies and their findings are mixed.  This requires a very broad search or multiple structured searches. "This should address each of the syntheses included in the review...[and] aims to find both published and unpublished studies."

Selection: Based upon inclusion criteria.  

  • Quantitative component -  consider any experimental study design before and after studies for inclusion
  • Qualitative component - consider studies that focus on qualitative data including, but not limited to, designs such as phenomenology, grounded theory, ethnography, action research and feminist research. In the absence of research studies, other text such as opinion papers and reports should be considered.
  • Textual component - consider expert opinion, discussion papers, position papers and other text
  •  Economic component - consider cost effectiveness, cost benefit, cost minimization, cost utility

Appraisal:  Address each of the syntheses included in the review

Example: Quantitative, Qualitative, Textual or Economic papers

The appropriate critical appraisal tool or method should be applied by study type or there should be one general tool used that will represent all study designs.

Synthesis: Depends on findings and included studies, applying mixed synthesis methods (qualitative: thematic synthesis/meta-ethnography & quantitative: statistical meta-analysis).  “The results of each single method synthesis included in the mixed method review will be extracted in numerical, tabular or textual format."

(Source: Joanna Briggs Institute 2014)