Hello, Are there alternative ways of approaching the problem of controlling for alpha inflation which consider instances with very small and hard to reach samples with which multiple hypothesis (which are all testing the same dependant variables)?
In my case, the Bonferroni correction is too restrictive: 1) Since the alpha is so small, it will make it hard to yield significant results and 2) It requires that I recruit too many participants for the number that is available in order to have sufficient statistical power. Indeed, my population is hard to reach because it is a very specific clinical population.
On the study: We want to identify which return-to-work obstacle predict return-to-work in organ transplant recipients. Return-to-work obstacles are measured using a single instrument, which has 10 independant subscales. Thus, 10 tests will be performed. For each test, there will be 2 independant variables : 1) How much a return-to-work obstacle (subscale) is perceived as importante (score : 1-7) and 2) How much self-efficacy one has regarding this obstacle/subscale (score: 1-7). The dependent variables are: 1) The intention do return to work (yes/no), 2) Employer's intention of welcoming the employee back (yes/no). The dependent variables are measured 6 months after the dependent variable.
Thanks so much in advance for your help! I am very thankful for this wonderful community.
Two approaches come to mind:
You can read about both of them here:
- http://westfall.ba.ttu.edu/ISQS6348/BonHolmBenHoch.htm
Keira Gaudet ,I would suggest also to use Bayesian methods, which are not limited by small samples
Bruce Weaver, thank you!
Rolando Gonzales : are Bayesian methods used at all in psychology? This is my thesis project, and I need to provide evidence that those methods have been proven in the field. The search I have done so far indicates that bayesian methods are not commonly used. Do you have a contrary opinion? Thanks!
Keira Gaudet , in fact psychology is one of the fields where Bayesian methods are thriving in success with increasing popularity:
From a review of 1579 articles that apply Bayesian methods in psychology:
" Although the statistical tools most often used by researchers in the field of psychology over the last 25 years are based on frequentist statistics, it is often claimed that the alternative Bayesian approach to statistics is gaining in popularity. In the current article, we investigated this claim by performing the very first systematic review of Bayesian psychological articles published between 1990 and 2015 (n = 1,579). "
https://psycnet.apa.org/doiLanding?doi=10.1037%2Fmet0000100
Maybe also of interest:
https://link.springer.com/article/10.3758/s13423-017-1343-3?wt_mc=Other.Other.8.CON1172.PSBR%20VSI%20Art04%20&%20utm_medium=other%20&%20utm_source=other%20&%20utm_content=2062018%20&%20utm_campaign=8_ago1936_psbr%20vsi%20art04
But I have to admit that I am biased, as I am Bayesian myself B-)
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Sampling Design
- Sample Size