Calculating the inter rater reliability for three coders in sets of two coders?

01 December 2020 1 4K Report

I have 74 statements that are coded independently by pairs of 2 coders (out of a total of 3 coders). So every pair of 2 coders rates (around) 24 statements. My data is continuous. Should I use the ICC1 to calculate the interrater reliability for the variable?

Andrea de Giorgio

I can suggest reading this page: http://finzi.psych.upenn.edu/library/DescTools/html/ICC.html

Though, I will follow myself this question for a better answer. Good question! :)

Badges
Science topic

What is the most reliable source to get Impact factor of journals?

Source to get Impact factor of journals

01 March 2021 6,654 2 View

Which index or sites are reliable in determining of plant species?

There are many indexes when determining plant species: Plants of the World Online (POWO), International Plants Names Index (www.ipni.org), The Plant List (www.theplantlist.org) and others. But...

26 February 2021 3,404 10 View

How do historians determine the credibility sources in modern history?

For a source to be considered reliable it must contain accurate historical information. But how does one determine the accuracy and reliability of sources in modern and recent history since not...

23 February 2021 1,346 13 View

PMSM Inter Turn Short Circuit fault, Dataset?

Hi, I'm looking for a dataset of a PMSM with an inter turn short circuit fault. Does anyone know a dataset which is available?

21 February 2021 5,663 2 View

How can we measure the reliability and validity of our survey questionnaire?

We are conducting survey research on COVID-19 misinformation among students. How can we validate our survey for it to produce valid and reliable data? Also, what statistical tools can we use to...

16 February 2021 678 3 View

What does the value 0.498 in reliability?

There are 6 television programmes of different TV genres and their mean and mean ranks are put for each of them. But the reliability value of all the programmes together is 0.498 . So what exactly...

15 February 2021 7,686 4 View

Where can I find a reliable and updated methodology related with the design of spiral heat exchangers?

I need to design an spiral heat exchanger, buy I don't know what reference or bibliography (preferably a book) should I consult in order to get an updated and reliable methodology related with...

14 February 2021 7,910 3 View

What are the popular techniques for pre-processing measurement data in Smart Grid/Power System?

The data collected from various measurement devices often contains erroneous values - such as noise, missing values, etc. What are the popular techniques for pre-processing measurement data in...

14 February 2021 4,642 2 View

Western blot protein of interest falling at a lower weight than expected?

My protein of interest is DAGLa (115 kDa). We received the antibody for this from another researcher who reliably shows bands at this weight. We do see a light banding at this weight, but the...

11 February 2021 6,009 3 View

Which kind of validity should e established in case we want to conduct a survey using newly developed survey questionnaire?

I am conducting a survey using self developed questionnaire. I have established its face validity and content validity. Some expert reviewer has suggested I must establish the validity by...

11 February 2021 2,077 3 View