The Opinion Survey will be used in the pilot study to investigate participants' perceptions of the pre&posttest and the instructional intervention. Not sure questions in the survey should be validated or not? Thank you.
If the questionnaire is important and sensitive, it is essential to pilot it before the main implementation. Prior to conducting the pilot, it is advisable to employ validation methods to enhance the process. For example, content validity should be established by having experts in the field review the questions to ensure they address all relevant aspects of the topic.
During the pilot phase, focus on several key elements: assess the respondents' cognitive perception of the questions, identify any ambiguity, evaluate the comprehensiveness of the response options, and review the overall structure of the questionnaire. Pay special attention to the order of the questions and options, as well as the initial layout of the questionnaire, to identify and resolve any potential issues.
If you are trying to assess the effectiveness of your questions, then I strongly advise that you use cognitive interviewing as a way to pretest your survey instrument. The general goal in assessing the validity of surveys is make sure that your questions mean the same thing to both your participants and yourself, and that is what cognitive interviewing is designed to do.