I want to get second opinion from experts for my priority vectors.
Should i use a AHP-format survey (asking for pair-wise comparisons) or a simple questionnaire asking them to rank every criteria would suffice ?
AHP provides a preference distribution, not an ordination nor a choice.
As far as I can understand your question, you have already an AHP application result, and want to confirm it, like a "reliability test".
Usually, we have some ways to confirm it (Carmines & Zeller, 1979).
Reliability Indicators
1.1. Internal Consistency Estimators
1.1.1. item-total correlation
1.1.2 Bipartition Methods
1.1.3 Kuder-Richardson Formula 20 (KR-20)
1.1.4 Cronbach's Alpha
1.2 Intra-Observer Reliability Indicators
1.3 Interobserver Reliability Indicator
I am not sure what is the most appropriate for you, but I think it is test-retest what you suggest.
Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Sage Publications.
It is better to use an AHP-format survey, including all the possibilities regarding the AHP scale. However, I would advise that the number of comparisons would not be excessive not to jeopardize the consistency of the responses.
- Badges
- Science topic
- Similar topics
- Vectorization