Hi Sergio, Validity is the extent to which a test (such as a chemical, physical, or scholastic test) accurately measures what it purports to measure. In the fields of management testing, “Validity refers to the degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests."
So. validation is the process of gathering evidence to provide “a sound scientific basis” for interpreting the scores as proposed by the test developer and/or the test user. Validation therefore begins with a framework that defines the scope and aspects (in the case of multi-dimensional scales) of the proposed interpretation. The framework also includes a rational justification linking the interpretation to the test in question.
Validity researchers then list a series of propositions that must be met if the interpretation is to be valid. Or, conversely, they may compile a list of issues that may threaten the validity of the interpretations. In either case the researchers proceed by gathering evidence – be it original empirical research, meta-analysis or review of existing literature, or logical analysis of the issues – to support or to question the interpretation’s propositions (or the threats to the interpretation’s validity). Emphasis is placed on quality, rather than quantity, of the evidence.
A single interpretation of any test may require several propositions to be true (or may be questioned by any one of a set of threats to its validity). Strong evidence in support of a single proposition does not lessen the requirement to support the other propositions.
Evidence to support (or question) the validity of an interpretation can be categorized into one of five categories:
Evidence based on test content
Evidence based on response processes
Evidence based on internal structure
Evidence based on relations to other variables
Evidence based on consequences of testing
For more information,have a look on the following links:
Popham, W. J. (2008). All About Assessment / A Misunderstood Grail. Educational Leadership, 66(1), 82-83.
http://en.wikipedia.org/wiki/Test_validity
Guion, R. M. (1980). On trinitarian doctrines of validity. Professional Psychology, 11, 385-398.
The answer can be squeezed in two words "Analytical Generalization". It is a way to test generalization of an existing management theory through case studies. Single case strategy, 1+1 strategy, etc.
Miller, K. D. and Tsang, E. W. K. (2011), Testing management theories: critical realist philosophy and research methods. Strat. Mgmt. J., 32: 139–158. doi: 10.1002/smj.868
Keywords:
critical realism;mechanisms;philosophy of science;research methods;theory testing
Abstract
This study identifies the practical and philosophical difficulties associated with testing strategic management and organization theories. Working from a critical realist perspective, we affirm the importance of falsification and verification efforts for progress in theory development. We advocate a four-step approach for advancing theory testing that prioritizes identifying and testing for the presence and effects of hypothesized causal mechanisms, rather than solely focusing on correlational methods to jointly test the set of effects composing a theoretical system. Going beyond prior critical realist writings, we provide practical guidance for deploying established research methods to test management theories.
There are hundreds if not thousands of "models of management" depending on the industry, the technology and knowledge bases, capital availability, competition, etc etc. Seeking one model, or to test one model, is like seeking the perfect solvent -noting works for everything every time.