I have 10 teams of 4. The subject is level of team creativity. Observational data uses a 5-point Likert scale (ordinal). Raters only rate their own team's level of creativity - they do not rate any other teams. A copy of my dataset is below:
Team Rater 1 Rater 2 Rater 3 Rater 4
1.00 4.00 4.50 4.80 4.80
2.00 5.00 4.30 4.80 5.00
3.00 3.50 5.00 4.50 5.00
4.00 3.50 4.00 4.30 3.80
5.00 5.00 5.00 4.00 5.00
6.00 4.00 5.00 4.00 4.50
7.00 4.30 5.00 3.30 3.50
8.00 4.00 3.80 3.80 3.30
9.00 4.00 4.00 5.00 3.00
10.00 4.00 3.50 4.80 4.30
My plan is to use ICCs to determine how reliable each rater's score was, as well how much of an impact team association had on the scores.
My questions are:
1) Which ICCs should I use? ICC(1) and ICC(K)?
2) What reliability test should I use in SPSS?
Yes SPSS reliability can be used. Use Cronbach ALPHA if the value is > 0.7 then internal consistency can be assumed.
- Badges
- Science topic
- Similar topics
- Mathematical Sciences
- Statistics
- Statistical Software
- SPSS