Discussing validity and reliability concerns in a mixed method research design always needs thorough and careful explanations.
Haji Karim - Traditionally empirical studies have been based on either quantitative or qualitative methods. Mixed method research or the use of multiple methods for assessing the validity and reliability of research data have been called between-method or cross- method triangulation. The aim of triangulation is to obtain accuracy in measurement between two points for which you require a way of measuring that is reliable.The theory of triangulation provides some degree of control over the accuracy of the data.
There are two types of triangulation, namely, methodological triangulation and theoretical triangulation. 'Methodological triangulation' refers to the way different methods are used in the research process, and 'Theoretical triangulation' is the way various theoretical perspectives are used.
Validity and reliability concerns in a mixed method research design need thorough and careful explanations because the objectivity of qualitative research is evaluated in terms of the reliability and validity of its observations. By reliability is meant the extent to which a measurement procedure yields the same answer however, and whenever it is carried out. Validity is the extent to which it gives the correct answer.
This can be done through consistency and precision: It is important to obtain consistently similar responses to the same questions in similar circumstances. In precision, one has to know how systematic is the form of data that is based on asking people questions about things that they know little about.
Three are three types of "Reliability" which can be used:
1. "Quixotic" reliability: This refers to the circumstances in which a single method of observation yields the same measurement over and over again.
2. "Diachronic" reliability: This refers to the stability of an observation over time.
3. "Synchronic"' reliability: This refers to the similarity of observations within the same time period, which can be evaluated by comparisons of the same data by different methods.
Validity refers to the accuracy of the data generated by the research instrument, whether it is an interview or questionnaire or some other means of research. Face validity means statistical measure of validity. For example, Type 1 error will require rejection of the hypothesis when it is true. Type II error will require acceptance of the hypothesis when it is false.
The "rigor" of the qualitative and quantitative components are typically assessed separately in mixed methods research. In particular, the concepts of reliability and validity are most often associated with quantitative research, where there are well-defined techniques for determine this information. In contrast, qualitative research typically uses a very different approach, based on concepts such as "credibility."
Overall, your approach to this issue depends on the role that each method plays with regard to the overall goals of your project.
In addition to what David Morgan wrote above, it's worthwhile to consider validity and reliability (or the qualitative analogues of these, sometimes referred to as credibility and trustworthiness) not only with regard to each strand -- qualitative and quantitative -- but also with regard to the integration of the two.
Onwuegbuzie and Johnson (2007) wrote about this to some extent, though the focus is more on validity or what they call "legitimation" than on reliability as such: http://www.msera.org/docs/rits-v13n1-complete.pdf#page=55
Assessing the validity and reliability of research data will be used triangulation method. The aim of the triangulation data collection method is to obtain accuracy in measurement between two points for which you require a way of measuring that is reliable.
- Badges
- Science method
- Similar topics
- Methodology