When developing an observer rated scale is test-retest reliability required?

More Danelle Pettman's questions See All

Estimatimating required sample size / effect size with McNemar statistic

I have an effect size from previous research of 1.56 but it uses different statistics, I am not sure how to calculate the required sample size? or the effect size of my findings?

04 May 2017 2,766 2 View

How does one derive the standard deviation of a scale?

Dear all, I am working on analyzing data from a survey on student satisfaction. The survey contains items with a 7-point Likert response format that produce 12 scales related to different areas...

05 August 2024 2,141 4 View

Should I remove an item from a scale to raise Cronbach's alpha and McDonald's omega or is it better to leave it if they are both over .7 already?

Hello! I have this scale which had 10 items initially. I had to remove items 8 and 10 because they correlated negatively with the scale, and then I removed item 9 because Cronbach's alpha and...

01 August 2024 4,606 7 View

Why 3 replicates for most biological assays? Is it enough to examine the data fits normal distribution?

Just bounced on me. Before statistically analysing significant difference, shouldn't we see if data fits normal distribution first? Is 3 replicates enough to testify the hypothesis of normal...

31 July 2024 8,141 13 View

Posthoc test lettering in JAMOVI?

Does anyone know of a module for the JAMOVI software that is capable of generating mean separations using the classic letters based on post hoc results (e.g., Tukey test)? If, as I believe, such...

31 July 2024 3,333 4 View

Can we eliminate the stress singularity at the tip of the crack by manipulating the elastic constants?

The aim of the research here is to prevent the propagation of the crack in the fabricated elastic medium with useful applications.

25 July 2024 9,976 3 View

Given the current advances in Super Computation and Quantum Computing, what are the missing link between the Applied AI and Ultra Smart Cyberspace?

In recent years, quantum computing has emerged as a groundbreaking technology with the potential to revolutionize various fields, including artificial intelligence (AI). AI has already made...

17 July 2024 1,398 3 View

Suggestion for PhD Research Topic/Topics in Applied Statistics?

Hi All I recently get admission in PhD statistics. After a long discussion with my supervisor, the topic I selected for PhD is " Air Pollution and its impact on Economy: A case study of...

15 July 2024 1,820 5 View

Can light itself have a temporal property? I mean, does light capable to dilate time if conditions require it?

About time dilation. We remember the descriptive diagram which includes, for example, the train which moves at a speed "v". The two mirrors installed in the train between which a beam of light...

03 July 2024 4,332 1 View

What should I do if a Journal is not included in Researchgate data base?

Is there a way to add new Journals in the system?

03 July 2024 1,691 2 View

How to overlay multiple (more than two) )Ligands/ single crystal xrd structures?

Can anyone know how to overlay 3 or more crystal structure/chamical structures by using any software like olex2, mercury or pymol. Mercury has a option to do.. i want to know the step by step process.

16 June 2024 6,871 0 View

Danelle Pettman

Thank you

Muayyad Ahmad

I think you can find suitable answer on reliability testing for observer rated scale in the following link.

https://www.ncbi.nlm.nih.gov/pubmed/19716180

Also, the attached file has more details.

Good luck

Nigel V. Marsh

A generalizability analysis, while more complex to complete than inter-rater reliability, does provide more useful information on how to improve reliability if it is low.

Michael Moore

As Lony observed, test-retest is not applicable here, and the main question is inter-judge reliability.