It is known that younger women in general often have higher mammographic density breast tissue, and the vast majority have no cancer. Did you try to adjust your findings to patient age?
Article Association between mammographic density and Basal-like and ...