When writing systematic reviews or meta-analyses one needs to evaluate the quality of the studies before deciding which studies to include in the review. There are different criteria used for different types of studies: RCT, observational studies, genetic studies economic evaluation studies, studies about assessment instruments etc. There is a whole literature on 'reporting guidelines' for these different types of studies. A couple of links are as follows:
uniform Requirements for Manuscripts. www.ICMJE.org
To assess the quality to studies about the theraputic interventions in medicine, the Cochrane Collaboration (which has developed the GRADE criteria) is the most authitative source.
When writing systematic reviews or meta-analyses one needs to evaluate the quality of the studies before deciding which studies to include in the review. There are different criteria used for different types of studies: RCT, observational studies, genetic studies economic evaluation studies, studies about assessment instruments etc. There is a whole literature on 'reporting guidelines' for these different types of studies. A couple of links are as follows:
uniform Requirements for Manuscripts. www.ICMJE.org
To assess the quality to studies about the theraputic interventions in medicine, the Cochrane Collaboration (which has developed the GRADE criteria) is the most authitative source.
An additional method to assess diagnostic accuracy studies is the Quality Assessment tool of Diagnostic Accuracy Studies (QUADAS). A QUADAS resource review is available at http://ebm.bmj.com/content/11/6/189.full.
From your terminology (reliability and reproducibility) am I right in thinking this is for risk assessment purposes? There are some specific tools developed for this but be very, very cautious in applying them - almost none have been validated, and many make fundamental errors which put them at high risk of producing biased results. Krauth et al. systematically reviewed the available tools quite recently (see attached link).
For why scales and scores in particular should be avoided, see Juni et al. (empirical evidence that scales don't work) and Greenland & O'Rourke (demonstration of why in principle they cannot work).
Article On the bias produced by quality scores in meta-analysis, and...
Article The Hazards of Scoring the Quality of Clinical Trials for Me...
Article Instruments for Assessing Risk of Bias and Other Methodologi...
Finally, I have used the COSMIN checklist to assess reliability and measurement error for carring out my systematic review. It is very easy to use and it have been validated in the literature.