Hi everyone,
I am currently in the process of reviewing feedback responses from my pilot survey (mixed methods with a mixture of closed and open ended questions).
One of the feedback that I have received from many of the respondents was they would like to choose more options in the question that I have asked e.g. Describe the type of service delivery that you provide (please pick up to three).
For this type of question, I don't think forced choice or check all that apply would be appropriate and I am trying to prevent people from satisficing answers for CATA. Most clinicians (targeted population) work with a variety of clients and my goal here is to get them to pick top three that they spent the most time in. I am not looking for them to rank based on my research question but what I am looking for is to see certain relationship e.g. respondents working in the education department seemed to be more confident in x. So basically in my case, all the options provided are of equal standing and what I am just looking for is for them to pick 3.
As mentioned, many of the respondents want to pick more than 3 and I am not sure what number is appropriate. I have tried looking for guidance by reading research articles related to survey designs and nothing relevant seemed to come up.
Basically my question is: does anyone know of any research evidence behind these multiple selection questions (why only three can be chosen) and if there is some formula to decide how many options the respondents should choose based on the number of options provided (e.g. if there are 6 options on the response stem choose only 2, if 12 choose 4 etc? ). If there is an expert in this field that has done specific research in this - please let me know of their names and I will look them up.
Thanks in advance.
Gen