We all dream about such data sets. Such data sets do exist from several clinical experiments, but cannot be distributed to the public. Currently big hospitals and ambulatory services are pilot testing for validation. This is not a common practice yet. These are patient clinical health records that you cannot get.
The 45 and Up Study in Australia has detailed linked data information on a large cohort of older Australians, although I'm not sure whether it collects the particular information you're after. https://www.saxinstitute.org.au/our-work/45-up-study/