How can i validate a questionnaire for hospitals' senior managers?
Hello everyone
-I performed a systematic review for the strategic KPIs that are most used and important worldwide.
-Then, I developed a questionnaire in which I asked the senior managers at 15 hospitals to rate these items based on their importance and their performance at that hospital on a scale of 0-10 (Quantitative data).
-The sample size is 30 because the population is small (however, it is an important one to my research).
-How can I perform construct validation for the items which are 46 items, especially that EFA and CFA will not be suitable for such a small sample.
-These 45 items can be classified into 6 components based on literature (such as the financial, the managerial, the customer, etc..)
-Bootstrapping in validation was not recommended.
-I found a good article with a close idea but they only performed face and content validity:
Ravaghi H, Heidarpour P, Mohseni M, Rafiei S. Senior managers’ viewpoints toward challenges of implementing clinical governance: a national study in Iran. International Journal of Health Policy and Management 2013; 1: 295–299.
-Do you recommend using EFA for each component separately which will contain around 5- 9 items to consider each as a separate scale and to define its sub-components (i tried this option and it gave good results and sample adequacy), but am not sure if this is acceptable to do. If you can think of other options I will be thankful if you can enlighten me.
Try to run EFA and CFA, though watch for the Total variance of the first component, if less than 50% continue. Then watch for KMO, there is research that supports values between 0.5 and 0.6, for exploratory these first.
After the survey is completed..but it is better to increase the number of studied samples..so that the result will be bette
Thank you for the answers. The sample is small (only 30). Unfortunately i cannot increase the sample size since the population of executives Is small.
It took more than a year to be able to collect this number from 15 hospitals.
i tried EFA for the whole questionnaire items it did not work
Content validity can perhaps be done with in-the depth interview... a mix of qualitative and quantitative methods, but EFA, CFA no because you have too many items and possibly many factors :-(
Hi , as i understand you have queries.
1.Validation of questionnaire : This can be done with content validity : for which you can take inputs from subject matter experts
2.Contrct validity :This can be done with Cronbach's Alpha for EFA and Discernment validity for CFA
3.for determination of sample size as thumb rule: your subject to item ration should be more than 10 .
Article Power Analysis for Parameter Estimation in Structural Equati...
https://library.oapen.org/bitstream/handle/20.500.12657/22385/9780367221898_text%20(1).pdf?sequence=1#page=240
I would perhaps change the approach. Factor analysis has its limitations and with such a small sample size I doubt that you can get a good model fit, you should use a polychoric matrix and for a Pearson matrix you need at least 200 subjects. Also keep in mind that you should do the confirmatory factorial on a different sample than where you have done the exploratory one.
Maybe you should try a RASCH analysis, although I speak from ignorance of the questionnaire you want to validate. This type of analysis in theory starts from the premise of unidimensionality, but given the sample size you are starting from, I would at least explore this possibility.
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Sampling Design
- Sample Size