Hello Dominick,

Rather than worry about a statistical test (especially since you didn't indicate a specific research question that would appear to call for one in your query), why not either:

1. Define a consensus threshold (e.g., a resource has to be endorsed by at least 2/3 of your group of domain experts in order to be considered relevant), and then identify all the resources meeting that threshold.

2. Rank the 80 resources by number of endorsements, in decreasing order.

Then, of course, discuss (and make some sense of) the results.

Good luck with your work.

Hi,

Since the aim of inferential statistics is to generalise the findings from a given sample to a larger population, the larger the sample, the more reliable the results.

It is generally accepted that a sample size of 30 or above is decent enough for the results of the tests to be taken seriously (https://www.researchgate.net/post/Minimum_sample_size_used_for_inferential_statistics#:~:text=the%20recommendation%20of%20a%20sample,many%20textbooks%20and%20academic%20sources.)

I would suggest that you spend a bit more time in collecting data so that you at least have a sample size that is larger than 30 so that your work (article) is not rejected by reviewers on this account.

Let's say that you don't have the time to do this, then you can try and justify your sample size based on the size of the universe using the formula and table developed by Krejcie and Morgan (1970).

https://www.kenpro.org/sample-size-determination-using-krejcie-and-morgan-table/

Krejcie, R.V., & Morgan, D.W., (1970). Determining Sample Size for Research Activities. Educational and Psychological Measurement.

As fas as tests are concerned, you could consider conducting Kendall's W test that is useful in understanding how respondents rank order options (or resources in your case).

I have a YouTube video on how to calculate this using SPSS/PSPP along with its interpretation- https://www.youtube.com/watch?v=V5DatPyVv98

All the best.

If the 80 variables are to some extent correlated, then you will need to refine your answer. Do your 80 variables fall into a small number of related groups where the correlation between variables within a group is higher than between groups?

Maybe I am trying to make this too complex: You have 80 resources. Are there 80 questions "Is Resource "A" useful? Yes, No?" In this case, could I interest you in the R package "PooledInfRate" ? For each variable, I want the mean number of yes votes and a 95% confidence interval about that mean. The report will be a list of resources grouped into "useful," "sometimes useful," and "not useful" depending on %yes and whether the confidence interval includes zero.

Hi, many thanks for your insights and valuable advice.

Dear David, let me specify the research question: These 80 resources represent different psychological phenomena (cognitive thinking styles and processes, personality traits, types of motivation, etc.). I aim to identify resources that are common for (i.e., facilitate both) creativity and empathy.

My experts are psychological scientists who work both on creativity and social cognition. To gain an initial indication of which resources to investigate further in the subsequent stages of the larger research project, I plan to begin by asking experts in this specific field to assess the extent to which a given facet is important for both empathy and creativity. Then, I will select approximately 20 most important facets out of the initial 80.

Dear Rama, thank you for your advice regarding the sample size.

Dear Timothy, I think that it is highly probable that these 80 variables fall into a small number of groups in which variables are related (perhaps groups of psychological profiles, or categories such as personality traits, cognition-related variables, emotion-related variables etc.).

For each resource there will be two 5-point Likert scale items:

Resource A

1) How important is Resource A for Creativity;

2) How important is Resource A for Empathy

(1-Not Important 5-Extremely Important).

Resource B

1) How important is Resource B for Creativity;

2) How important is Resource B for Empathy

(1-Not Important 5-Extremely Important).

etc.