Hi there,
I need assistance with interpreting the outcome of my pairwise comparisons from my datasets. I've been running a glmer mixed models and selecting the best model using the AIC criteria. Please view my post on stack for all the code:
https://stackoverflow.com/questions/45369820/pairwise-comparisons-of-contrasts-from-lsmeans-p-value-adjustment
I read that for mixed models where the distribution is not normal, Tukey's HSD isn't advised. This would appear to be true given how highly significant the interaction between Pre and Adult is. When I put the Tukey's HSD adjustment in, I lose nearly all the significant pairwise comparisons.
So for the time being I've specified the adjustment as NULL (I've looked at SIDAK adjustment too but still lose these signficant pariwise comparisons). Looking at my data visually, the data appear to match the stats when the NULL adjustment is applied.
I would like some advice as to whether or not I should report these contrasts and if so how I report them, considering there is no post-hoc adjustment. ie. do I say: "all pariwise comparisons were computed from the contrasts between factors using lsmeans package".
Any help would be greatly appreciated. I hope I'm going about this the right way!
Thanks!
Dave