Want to check survey data/feedback collected from different stakeholders by survey regarding our undergraduate program. What factors should we consider about sample size, the reliability of data collected or result obtained by the survey? Each question has five options like strongly agree, agree, neutral, disagree and strongly disagree. We have around 20 faculty members, roughly 20 nonacademic staff, 120 ug students, approximately 500 alumni and many employers. Usually, it is tough to get feedback from the employer within a short period.
The questions you asked about sampling and reliability are separate issues from validity. Measuring reliability usually requires multiple measures of the same underly concept -- such as several questions that go together to make up a scale. If each of your items was designated for a different purpose, then you probably don't have the resources to assess reliability.
In contrast, validity asks whether a measure performed in the ways that you intended it to. I suggest you do some reading on the idea of "construct validity."
Thanks. Actually, University Grand Commission designs all questionnaires/survey forms. We have only to conduct the survey and make a report. I am worried about the impact of sample size on our result. Also, want to check whether the data were collected properly.
A lot depends on the kind of report you are going to write. If it is just descriptive statistics (means, per centavos, etc.) then you should include a note with any table that reports small N's.
My answer would be different, however, if you are planning to run tests of statistical significance, such as ANOVA.
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Sampling Design
- Sample Size