How to conduct a meta-analysis of inter-reader agreement of certain evaluation method?
Can analysis be performed without a 95% confidence interval of κ?
Which software is needed for the analysis？
Could you provide the operation codes of relevant analysis of stata14 software？
Thank you very much for your reply.
You may have look for this paper from Sun (2011) who report this analysis using the R software and metafor library. Be aware that Kappa is also associated with limitations (aka Kappa paradoxes) that may need to be accounted for in your final model. The standard errors associated with Kappa have also been criticised despite their common use in practice.
Good luck!
Sun, S. Meta-analysis of Cohen’s kappa. Health Serv Outcomes Res Method 11, 145–163 (2011). https://doi.org/10.1007/s10742-011-0077-3
Good morning Ning Wang, I've used meta a long time ago, but not sure if it can be useful for your question. Re; Sébastien Buczinski's mention of kappa. I used it in my dissertation, you can read my MJA article on diabetes on this site. But I note that also values for kappa differ; in Armitage and Berry Statistical methods for medical research the cut off values were different to an article I read in the Aust. New Z. J of Public Health [can't recall the exact article] as it gets too finicky, so I don't keep a record of specifics but I did note that at the time. Thanks
- Badges
- Science method
- Similar topics
- Mathematics
- Statistics
- Statistical Techniques
- Meta-Analysis