i have used an observation checklist to distinguish the behavior between the two groups say an experimental (n=5 )and a control group(n=5) in terms of reflection.? i wonder if it is valid or if it i sufficient to report the results quantitatively?
It is a matter of being able to demonstrate that the checklist is measuring (recording) the items of interest. For instance: if you are performing an observational study on hand washing. Your check list “washes hands- yes/no”. What are you trying to determine? If a provider washes their hand? Or the quality of the hand washing? A checklist with just the one question above doesn’t determine (describe) quality just if hand washing was performed. If Your study (checklist) is to determine a more involved outcome your checklist component parts must be able to capture all aspects. The questions you must ask are , “what is my research question (s)?” ; “ do the checklist components contain all of the variables needed to come to a conclusion?”.
Several of your colleagues should review your research questions and your checklist with a critical eye. This process should suffice Along with your supporting literature review.
you may find this useful: Sandelowski, M. (2015). A matter of taste: evaluating the quality of qualitative research. Nursing inquiry, 22(2), 86-94.
It is a matter of being able to demonstrate that the checklist is measuring (recording) the items of interest. For instance: if you are performing an observational study on hand washing. Your check list “washes hands- yes/no”. What are you trying to determine? If a provider washes their hand? Or the quality of the hand washing? A checklist with just the one question above doesn’t determine (describe) quality just if hand washing was performed. If Your study (checklist) is to determine a more involved outcome your checklist component parts must be able to capture all aspects. The questions you must ask are , “what is my research question (s)?” ; “ do the checklist components contain all of the variables needed to come to a conclusion?”.
Several of your colleagues should review your research questions and your checklist with a critical eye. This process should suffice Along with your supporting literature review.
you may find this useful: Sandelowski, M. (2015). A matter of taste: evaluating the quality of qualitative research. Nursing inquiry, 22(2), 86-94.
Great answer by Christopher above and I have recommended it. I would only add that one risk to beware of would be variable interpretation of questions by the respondents which may render your results unreliable. Question language precision would help to lessen that risk. You could test that with your research colleagues in a trial.
It may also be possible to find ways to triangulate responses thereby increasing the reliability of your outputs.