We are starting a research project with a Delphi panel in which we invite dentists from the whole world to evaluate a screening instrument and its guidelines. My question is, as we wish to learn about the usefulness of the instrument in the countries and cultural perceptions of the users, we need to account for the level of the country. At this moment we have for most countries only one expert participating, but for some countries, we have two. As we are calculating the level of agreement, do we have to have one expert per country or can we leave some countries with two? Can this bring a bias to the research? How do we correct this? Does anyone have experience with this?
Thank you so much!
If you have just one doctor from some countries, you may end up with a biased result. Please try to consider at least five doctors per country and take the mode of their results.
If you cannot do so, then ask each doctor to participate and to describe their results in detail. You may use a questionnaire for the same. Observing their results may help you to reduce bias.
Hello, please take a look at this research. These statistical coefficients are used for determining the conformity or reliability of experts' evaluations, and the Kendall coefficient with a value greater than or equal to 0.7 was considered as the stopping index for the procedure of the Delphi method.
Article A roadmap for a leanness company to emerge as a true lean organization
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Sampling Design
- Sample Size