Can the kappa value for different pairs of raters be averaged to get an average value for inter rater reliability?

12 December 2018 0 8K Report

Hi there, I have a data from 10 different pairs of raters. Two raters rated a single patient in different time period (meaning 10 different cases were used) generating 10 different kappa values for each pair of raters. In this case how can I generate a summary value of kappa? Can these 10 kappa value be used to produce the average value manually?

Badges
Science topic

What is the most reliable source to get Impact factor of journals?

Source to get Impact factor of journals

01 March 2021 6,654 2 View

Which index or sites are reliable in determining of plant species?

There are many indexes when determining plant species: Plants of the World Online (POWO), International Plants Names Index (www.ipni.org), The Plant List (www.theplantlist.org) and others. But...

26 February 2021 3,404 10 View

How do historians determine the credibility sources in modern history?

For a source to be considered reliable it must contain accurate historical information. But how does one determine the accuracy and reliability of sources in modern and recent history since not...

23 February 2021 1,346 13 View

Interpretation of Goodman - Kruskal Gamma squared?

Dear colleages, Eta squared is dominantly used in reflecting the explaining power the same manner as a squared partial correlation coefficient (R2p ) from multiple linear regression: as the...

22 February 2021 7,801 3 View

How can we measure the reliability and validity of our survey questionnaire?

We are conducting survey research on COVID-19 misinformation among students. How can we validate our survey for it to produce valid and reliable data? Also, what statistical tools can we use to...

16 February 2021 678 3 View

What does the value 0.498 in reliability?

There are 6 television programmes of different TV genres and their mean and mean ranks are put for each of them. But the reliability value of all the programmes together is 0.498 . So what exactly...

15 February 2021 7,686 4 View

Where can I find a reliable and updated methodology related with the design of spiral heat exchangers?

I need to design an spiral heat exchanger, buy I don't know what reference or bibliography (preferably a book) should I consult in order to get an updated and reliable methodology related with...

14 February 2021 7,910 3 View

What are the popular techniques for pre-processing measurement data in Smart Grid/Power System?

The data collected from various measurement devices often contains erroneous values - such as noise, missing values, etc. What are the popular techniques for pre-processing measurement data in...

14 February 2021 4,642 2 View

Western blot protein of interest falling at a lower weight than expected?

My protein of interest is DAGLa (115 kDa). We received the antibody for this from another researcher who reliably shows bands at this weight. We do see a light banding at this weight, but the...

11 February 2021 6,009 3 View

Which kind of validity should e established in case we want to conduct a survey using newly developed survey questionnaire?

I am conducting a survey using self developed questionnaire. I have established its face validity and content validity. Some expert reviewer has suggested I must establish the validity by...

11 February 2021 2,077 3 View