Hi,

We have few AI (Artificial Intelligence) solutions for different problems in public health. Few of the problems are binary in nature, while the rest is continuous. We need help in calculating sample size for measuring the accuracy of the AI (to reliably predict the problem).

For example, we developed an AI solution to estimate weight of a baby. We expect the AI to predict the weight reliably in 90% of babies - error to be less than 10% of actual weight by gold standard equipment. I can calculate sample size in two ways, I think:

  • Assuming that variable of interest is binary - reliability of the AI prediction (yes/no)
  • Assuming that variable of interest is continuous - actual error of AI prediction (grams - or %)
  • What should we choose? In the second option, which SD should we choose for ss calculation?

    Thanks for reading and suggesting in advance.

    PS - both the methods are applied on same study participant.

    More Dr Malay Shah's questions See All
    Similar questions and discussions