I have invited 20 raters to evaluate 10 stories on two 7 point likert scale (originality and practicality). I want to find the reliability for both originality and practicality separately.
Sample Question, first and second configuration (for originality only, you can expect the same for practicality) is attached below.
Hi Tahir,
To encode your data, I suggest the following presentation: raters in lines and your dependent variables in columns (STORY1_ORIG; STORY1_PRACT; STORY2_ORIG; STORY2_PRACT; etc.).
Then, regarding the reliability, I don't understand very well why you would like to perform this test. I guess you are running a pilot experiment to select stories that will present specific patterns of originality and practicality?
What is the purpose of testing originality and practicality in your stories?
In any case, here is the procedure on spss: https://statistics.laerd.com/spss-tutorials/cronbachs-alpha-using-spss-statistics.php
Best regards,
Julian
Thanks Julian Nasello ,
But I have seen many tutorials like this: https://www.youtube.com/watch?v=1Avl7DzKmnc
Where instructor put raters as columns. I am puzzled now : (
Your question: What is the purpose of testing originality and practicality in your stories?
Answer: to check in the inter-rater reliability
- Badges
- Science topic
- Similar topics
- Correction