I am measuring the surface roughness of 3D printed tensile specimens, that have different raster angles and raster widths.
Calibration and proper fixture of the specimens are set up to conduct the experimentation. However, upon measuring and re-measuring the surface roughness of all 30 specimen, R squared values yield 0.91, adjusted, 0.85, but predicted, 0.47.
I measure 4 raw values across the width of the tensile specimen before utilising the average for generating the ANOVA r squared values. I have even tried using one set (instead of the average of all 4) of raw values but to not much success on the predictive front. So it's made me curious.
What are some useful techniques for instance when going about identifying potential specimen outliers, when it's difficult to know which surface roughness value is 'correct' from the raw values obtained?
I've attached a snapshot of my Fit Statistics from the ANOVA using Design Expert 13 software. I know I can reduce the model using techniques like backward elimination but, I'm trying to get high R squared values natively without doing that.
Any advice will be most appreciated!