Dear all,
I'm currently working on a study focusing on the effects of employees' perceptions of a specific attribute of their leaders on their performance. In most research, I see that demographic variables or constructs like job satisfaction have been used as control variables to prevent any alternative explanations between the IVs and DVs. In some research though, I see that those control variables are also regressed on IVs, in my case employee perceptions of leadership, and the research then includes the residuals to the regression with the DVs with the same control variables also controlling the DV besides the IVs.
It seems a bit confusing in here. Though I understand the logic of regressing the control variables to the IVs, I am still unclear on whether controlling the DVs only would not be sufficient to prevent the effects of control variables in overall?
What should be the general procedure? Is it always critical to control IVs and DVs separately?
Usually people enter the control variables as additional predictors in a regression analysis. There are a number of sources (below) on control variables suggesting they should be used cautiously if at all. If you want to rule out that your results could be due to control variables, run your regression analyses both ways--with only your DV and IVs, and then with the control variables added. If results are similar, you have ruled out the control variables. If results change, it will not be clear why. It could be that the control variables are responsible for the DV-IV relationships, but other possibilities exist, and without additional information, you won't know what to conclude.
The following sources will go into detail:
Atinc, G. M., Simmering, M. J., & Kroll, M. J. (2012). Control variable use and reporting in macro and micro management research. Organizational Research Methods, 15, 57-74.
Becker, T. E. (2005). Potential problems in the statistical control of variables in organizational research: A qualitative analysis with recommendations. Organizational Research Methods, 8, 274-289.
Becker, T. E., Atinc, G., Breaugh, J. A., Carlson, K. D., Edwards, J. R., & Spector, P. E. (2015). Statistical control in correlational studies: 10 essential recommendations for organizational researchers. Journal of Organizational Behavior.
Bernerth, J. B., & Aguinis, H. (2015). A critical review and best-practice recommendations for control variable usage. Personnel Psychology, n/a-n/a. doi:10.1111/peps.12103
Spector, P. E., & Brannick, M. T. (2011). Methodological urban legends: The misuse of statistical control variables. Organizational Research Methods, 14, 287-305
Usually people enter the control variables as additional predictors in a regression analysis. There are a number of sources (below) on control variables suggesting they should be used cautiously if at all. If you want to rule out that your results could be due to control variables, run your regression analyses both ways--with only your DV and IVs, and then with the control variables added. If results are similar, you have ruled out the control variables. If results change, it will not be clear why. It could be that the control variables are responsible for the DV-IV relationships, but other possibilities exist, and without additional information, you won't know what to conclude.
The following sources will go into detail:
Atinc, G. M., Simmering, M. J., & Kroll, M. J. (2012). Control variable use and reporting in macro and micro management research. Organizational Research Methods, 15, 57-74.
Becker, T. E. (2005). Potential problems in the statistical control of variables in organizational research: A qualitative analysis with recommendations. Organizational Research Methods, 8, 274-289.
Becker, T. E., Atinc, G., Breaugh, J. A., Carlson, K. D., Edwards, J. R., & Spector, P. E. (2015). Statistical control in correlational studies: 10 essential recommendations for organizational researchers. Journal of Organizational Behavior.
Bernerth, J. B., & Aguinis, H. (2015). A critical review and best-practice recommendations for control variable usage. Personnel Psychology, n/a-n/a. doi:10.1111/peps.12103
Spector, P. E., & Brannick, M. T. (2011). Methodological urban legends: The misuse of statistical control variables. Organizational Research Methods, 14, 287-305
Paul and Michael, thank you very much for your detailed and prompt responses. They helped me a lot and it seems that I got my query replied by you both. Much appreciated!
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Regression