1. What is the impact of having different scales in a survey? and how can we solve this problem before and after data collection (Literature-based reflection)?
Thank you for your time and for sharing your experience.
A construct could be examined using an overall composite scale, having two or more subscales. For instance, Perceived Stress Scale (PSS) comprises two subscales, positively worded items and negatively worded items. The overall score points to the level of stress as perceived by participants. That being said, the findings of the following study pointed out that it is better to evaluate the effects of each PSS subscale separately when looking into perceived stress.
Jiang, J. M., Seng, E. K., Zimmerman, M. E., Sliwinski, M., Kim, M., & Lipton, R. B. (2017). Evaluation of the reliability, validity, and predictive validity of the subscales of the perceived stress scale in older adults. Journal of Alzheimer’s Disease, 59(3), 987–996. https://doi.org/10.3233/JAD-170289
Basically negative impacts and relatively measurement error.
Before data collection, experts could help in the face and content validity. After data collection, a Factor Analysis could be run to see how each item performs (rotates or loads) well through finding the commonality and initial rotation