I have an IRT question regarding calibration of the items. I am also aware of the item parameters are invariant to the sample using which they are estimated.

Suppose there are three schools, namely:A,B,and C. Students in school A are having below the average intelligence (IQ) and the school doesn't have exposure to computerized adaptive test (CAT) while students in school B have moderate IQ and have partial information about technology of the CAT, whereas students from School C are the brightest ones and also they are experienced with CAT.

Suppose, We have estimated the item parameters of an item bank (of say Mathematics subject) using response data from the school C (students with not so good intelligence and not aware of CAT)

Now suppose if I assume the item invariant assumption of IRT to be true and ask school C(one with bright students) students to take the test on same item bank, and turns out they all perform well.

So adjustments should I do with item bank so that I should be able to compare the results students from School A , B, and C with the numerical score I have got from the test.

Is this test a good way to compare these students?

Would the results be different had I estimated the item parameters using the response data from school C? (First thought comes to my mind is yes).

Am I missing something here?

I am open to the discussion.

Thank you in advance.

More Irshad Samdani Mujawar's questions See All
Similar questions and discussions