We've run GWAS on special traits. Unfortunately our cohort is unique in its kind. We cannot replicate. We can only validate and verify results in the context of other (related) traits or find alternative statistical methods to do so. Do you know any statistical method to robustly show/confirm an association? Do you know any convincing wet lab techniques that might prove the point that a certain variant, gene or locus is mechanistically involved in our traits?
There are quite a few approaches. E.g. you can try a cross-validation approach or partition your data into testing and training datasets.
There are quite a few approaches. E.g. you can try a cross-validation approach or partition your data into testing and training datasets.
Cross-validating results is always a very good thing to do, whenever possible. However, association studies are not predictions, and a standard k-fold cross-validation is less straightforward to apply.
In such cases, I would suggest alternative resampling strategies like bootstrapping or jack-knife: this will allow you to replicate the analysis and isolate true signals from background noise (i.e. spurious associations)
Surely you don't expect me to run bootstrapping on a genome-wide scale... I can run GWAS first and than run permutations/bootstrapping for the interesting loci. Is that a good idea?
The total sample size 1,439. So I don't know about cross-validation (with a training and testing sample set), because than groups (of phenotypes etc) will become small and thus power (which is already on the [very]-low) will be very-very low in the training sample set. What do you think?
I made a general comment on resampling strategies for inferential problems. The computational feasibility is of course to be evaluated for each case. This naturally depends on the number of bootstrap (or jack-knife) replicates you intend to perform. Permutations are another resampling technique that would allow you to build a robust threshold for the identification of true signals. Again, the number of replicates is important and stems from a compromise between size of the problem and validity of results.
As for cross-validating results, you surely would incur in low power problems, and I also think the validation part risks to be rather weak: what would you be using the test set for?
Is your GWAS on complex, i.e. polygenic or mono-/oligogenic phenotypes, in humans or animals or plants?
Are you interested in single marker results per se and nothing else?
In addition to Sophie's suggestions the co-occurring association of other SNPs in high LD would at least provide a hint against genotyping errors.
Moreover for complex (polygenic) phenotypes you could try multimarker methods like pathway/gene set based analysis or polygenic score based analysis using CV.
Lab techniques could mean e.g. create and test a (conditional) knock-out animal (rodents, drosophila, ...) model for the respective genes/phenotypes (time consuming) or do research in corresponding cell cultures.
Many thanks for these useful answers.
@Josef Frank: It is a complex, presumably polygenic trait GWAS in humans: several markers of atherosclerosis. I'm interested in single-marker results. Yes, I do check the imputation quality, HWE, allele frequency of the top variant and those close by - so as to make sure it's not a lone wolf although, that could still be a valid result. I'm actually also experimenting with gene-based association analyses (VEGAS) and I was thinking of using these results in pathway analysis. Indeed, I'm also running polygenic models using our GWAS results as training dataset, and a GWAS dataset of a closely related phenotype to validate.
@Sophie Limou: I shall check out the permutation testing in PLINK, but I'm actually running SNPTEST analyses as our dataset is imputed using IMPUTE2... Don't think there is a permutation testing method in that package... Or is there? In terms of functional in silico analyses, I do lookup whether our top-hits (or their proxies) have any other functional role (eQTL, GWAS hit) using for instance HaploReg, eQTL datasets, etc.
Thanks!
- Badges
- Science topic
- Similar topics
- Bioinformatics
- Bioinformatics and Computational Biology