Hi all,
I'm currently working on a project in which questionnaire data are being analyzed to determine the efficacy of program outcomes. In this case, there are approximately 40 questions that measure four personality traits (i.e., every grouping of 10 questions loads onto one trait) which the program itself is designed to foster. So the cohorts coming through and staying in the program would learn how to be resourceful, confident, independent, and creative.
What I've done up to this point is analyze the data (using a combination of IRT and CTT methods to assess validity, reliability, measurement invariance, response patterns, effect sizes between demographic groups, etc...) in order to establish a foundation that could answer questions about how effective this program is at developing those four skills/traits.
What I'd like to do as a next step is seek out other organizations that measure using a framework for the purposes of comparison and contrast. My question is, would this be a valuable next step? My issue is I'm having a difficult time finding organizations that use a similar framework. Are there any other frameworks to which these data could be compared to inform the evaluative process for our program?
Thank you in advance!
Your approach seems a little strange to me. Usually, surveys are based on theoretically sound research approaches and are not simply carried out on the basis of any presumed connections. The first step in an empirical research design is to define the research subject and the research questions. An adapted survey should then be based on this in order to finally be able to come to usable results, whereby in the best case some of the research hypotheses can be verified or falsified. Adapting existing survey results is certainly very questionable and often does not lead to a usable result.
- Badges
- Science topic
- Similar topics
- Philosophy
- Esthetics
- Interpretation