I am doing an Impact assessment on an intervention Program among high school students.
I have 4 schools where the intervention was conducted. From those schools I will have the control and the intervention groups.
I am wondering which technique or analysis methodology should I use because it was highlighted that PSM is not a good model.
Please enlighten me.
Difference in Differences (DID) model of econometrics. See woodridge econometrics.
If you do difference in differences estimations is better, You can also use the Cochrane formulae to reduce sample bias. However, PSM still is better off since it allows full control of covariates. Check on the weakness of DID model.
Applying PSM or ESR models are also preferable aside the DID model.
Peterson Machango , I think you can also use either the synthetic control method or the treatment effect.
One you have to consider the data very carefully.
1. PSM, ATT, Heckman, or ESR is the method to use if you cannot get the data for years that the intervention did not take effect.
2. If you can get the previous year's data in which the program was not effective, and then the data for the years that the program is effective then the best model is DiD.
Read on impact assessment analysis and I have a book on that you can share your email and I will send you a copy.
Peterson Machango try DID model or a treatment effect technique
Agree with the above comments though the choice of the models depends on whether you have baseline data before the intervention or not. If the treatment in the schools was not random it is also worth collecting data on criteria for selecting students as you shall account for the pre-treatment differences.
Download this book "Handbook on Impact evaluation" by Shahidur R, Khandker, Gayatri B. Koolwal, and Hussain A, Samad.
They have provided the step-by-step guide for impact evaluation studies and also provided the STATA commands for all the models you will like to employ in the study.
Once you have this book you are good to go on all impact evaluation studies or research.
- Badges
- Science method
- Similar topics
- Methodology