1. Z. A. Al-Hemyari and A. M. Al-Sarmi (2016). Validity and Reliability of Students and Academic Staff’s Surveys to Improve Higher Education. Educational Alternatives, Journal of International Scientific Publications, Vol.14, pp. 242-263
2- A. M. Al-Sarmi and Z. A. Al-Hemyari (2014). Quantitative and qualitative indicators to assess
the performance of higher education institutions. Int. J. of Information and Decision sciences,
Vol.6, No. 4, pp.369-392 (Inderscience).
3- Z. A. Al-Hemyari and A. M. Al-Sarmi (2014). Statistical characteristics of performance indicators. Int. J. of Quality and Innovation. Vol.2, No.3-4, pp. 385-309 (Inderscience).
You can use alpha because it is simply based on a correlation matrix, rather than any assumption about what the source of that matrix is. Where you might run into problems is that correlations based on dichotomous data depend on the distribution of the data in each variable, so that it is often difficult to reach a maximum of 1.0. This means that it can be more difficult for your alpha to reach what is generally considered an acceptable level of .7.
Dichotomous variables, can be treated as parametric variables. Pearson Corr is suitable. Cronbach's alpha is based on the average correlation between all variables. This can perfectly be calculated. Considering the risk indicated by David test if all variables in your set form a unidimensional scale (by Principal Components Factor Analysis, only on factor with an eigenvalue above 1), eliminate all variables causing alpha to drop, try to increase the number of variables. Keep in mind that alpha tests the internal consistence of a scale it is surely about reliability, lass about validity.
There are different options of testing reliability and validity. Choosing one of these ways depends on the feasibility and situation of the examiner. However, all leads to a same conclusion. On this case, split-half reliability, Cronbach alpha, if possible test-retest and so on can use to test reliability. For validity u can do content validity by giving expert to rate your test items, or u can compare to a standardized scale that measure same area. In summary, no matter whether it is checklist or scale you can have different options for assessing reliability and validity.
you can use cronbach alpha method for testing reliability and for validity use construct validity and concurrent validity. Cronbach Alpha mainly gives idea about the coherence that all items measuring the same attribute or not so doesn't matter whether the item are dichotomous or not
1. Z. A. Al-Hemyari and A. M. Al-Sarmi (2016). Validity and Reliability of Students and Academic Staff’s Surveys to Improve Higher Education. Educational Alternatives, Journal of International Scientific Publications, Vol.14, pp. 242-263
2- A. M. Al-Sarmi and Z. A. Al-Hemyari (2014). Quantitative and qualitative indicators to assess
the performance of higher education institutions. Int. J. of Information and Decision sciences,
Vol.6, No. 4, pp.369-392 (Inderscience).
3- Z. A. Al-Hemyari and A. M. Al-Sarmi (2014). Statistical characteristics of performance indicators. Int. J. of Quality and Innovation. Vol.2, No.3-4, pp. 385-309 (Inderscience).