I've recently written and submitted a literature review that provides a narrative synthesis of 30 studies, half of which are quantitative (using various methods) and half qualitative. I make clear in the introduction that part of the value of the review is in bringing together a wide range of studies that look at the same issue from a range of disciplinary perspectives, using a variety of methods.
On review, one of the reviewers has suggested that I combine the findings in a meta-analysis. Is this even feasible given that the review covers both quantitative and qualitative papers? If so, what methodology would I use? (I'm aware of the Timulak papers on qualitative meta-analysis, but am not aware of anything that enables you to combine quan and qual). The methods of the included studies range from discrete choice analyses to quantitative content analyses, to semi-structured interviews, to ethnography. Surely much of the value of each study would be lost if they were somehow pulled together in a meta-analysis?
Would I be justified in rejecting this suggestion and reiterating that the review provides a narrative synthesis of a range of study types?
Thanks.
I don't think that qualitative and quantitative results can be squeezed into one "meta-analysis" in a meaningful way. So I think you need to rebuttal that request.
You might want to look into the methodology of "scoping review" - I think it gives you flexibility in integrating different methodologies without readers / reviewers expecting a "meta-analysis".
Good luck!
Hello,
- First, you can submit the literature review based on the 30 studies, and report the research design of each one and use the narrative synthesis.
- Next, (if possible) try to publish a meta-analysis of the other half of the quantitative articles. You may search for more quantitative papers to have an adequate sample.
Good luck!
When we conduct any research it may possible that data will be quantitative or qaulitative. Qualitative data is always better for Research, so form your questions in such way that data will be more qualitative rather than quantitative.
Try to take validated questionnaire.
Thank you.
The offered recommendations are thoughtful and likely correct, but they my be be too mechanical. Think of meta-analysis as being a weighted average of effects where the weights are inversely proportional to variances. So, to perform a meta-analysis, you need to argue that (1) the effects across studies can be justifiable averaged, and (2) the individual effects have statistically meaningful standard errors. Most qualitative studies would be rejected on one or both criteria. You might use this logic in response to your reviewer. You might be interested in my 2012 paper on meta-analysis in Evaluation Review.
Thanks Dr. William Rhodes William Rhodes
That's what I meant exactly for the second study (meta-analysis). Definitely, qualitative studies never meet the inclusion criteria of any meta-analysis. As mentioned, the half (about 15 studies) are quantitative, it still possible to perform a meta-analysis for these 15 studies if they meet the criteria. To increase the sample, Dr.Victoria Victoria Charlton can apply more inclusion criteria and add some recent published (unpublished ) articles to the sample. This might be your future project.
Now, stay focus on your current literature review as it is, you may consider to publish it in another journal.
Good luck!
I agree with William Rhodes that a lot depends on how specific the reviewer was in their request for a "meta-analysis," which in its strictest form produces quantitative summaries of effect sizes. And on the qualitative side, there is a somewhat analogous process called "meta-synthesis." But if you make it clear that you are doing a narrative review, then neither of these more specialized formats is relevant.
Hello
In my opinion, you have to review MIXED METHODOLOGY:
https://pcmh.ahrq.gov/page/mixed-methods-integrating-quantitative-and-qualitative-data-collection-and-analysis-while
Best regards
Ph.D. Ingrid del Valle Garcia Carreño
- Badges
- Science method
- Similar topics
- Methodology