The scale I am assessing is other rated and I was wondering if test-retest is still applicable?
Thank you
I think you can find suitable answer on reliability testing for observer rated scale in the following link.
https://www.ncbi.nlm.nih.gov/pubmed/19716180
Also, the attached file has more details.
Good luck
A generalizability analysis, while more complex to complete than inter-rater reliability, does provide more useful information on how to improve reliability if it is low.
As Lony observed, test-retest is not applicable here, and the main question is inter-judge reliability.
I have an effect size from previous research of 1.56 but it uses different statistics, I am not sure how to calculate the required sample size? or the effect size of my findings?
04 May 2017 2,766 2 View
Dear all, I am working on analyzing data from a survey on student satisfaction. The survey contains items with a 7-point Likert response format that produce 12 scales related to different areas...
05 August 2024 2,141 4 View
Hello! I have this scale which had 10 items initially. I had to remove items 8 and 10 because they correlated negatively with the scale, and then I removed item 9 because Cronbach's alpha and...
01 August 2024 4,606 7 View
Just bounced on me. Before statistically analysing significant difference, shouldn't we see if data fits normal distribution first? Is 3 replicates enough to testify the hypothesis of normal...
31 July 2024 8,141 13 View
Does anyone know of a module for the JAMOVI software that is capable of generating mean separations using the classic letters based on post hoc results (e.g., Tukey test)? If, as I believe, such...
31 July 2024 3,333 4 View
The aim of the research here is to prevent the propagation of the crack in the fabricated elastic medium with useful applications.
25 July 2024 9,976 3 View
In recent years, quantum computing has emerged as a groundbreaking technology with the potential to revolutionize various fields, including artificial intelligence (AI). AI has already made...
17 July 2024 1,398 3 View
Hi All I recently get admission in PhD statistics. After a long discussion with my supervisor, the topic I selected for PhD is " Air Pollution and its impact on Economy: A case study of...
15 July 2024 1,820 5 View
About time dilation. We remember the descriptive diagram which includes, for example, the train which moves at a speed "v". The two mirrors installed in the train between which a beam of light...
03 July 2024 4,332 1 View
Is there a way to add new Journals in the system?
03 July 2024 1,691 2 View
Can anyone know how to overlay 3 or more crystal structure/chamical structures by using any software like olex2, mercury or pymol. Mercury has a option to do.. i want to know the step by step process.
16 June 2024 6,871 0 View