This morning I received an email informing me that a paper I co-authored had zero potential statistical errors. Apparently the check was performed by a piece of software called Statcheck as part of a massive effort to double check results in psychology. While this is good news for my paper, I have mixed feelings about a relatively new piece of software being used for a massive sweep of published results and then commenting on the number of errors it detected. Has anyone else had a paper checked? How do you feel about it? I want to say this is great for open science, but it would be unfortunate if the software incorrectly flagged results from young researchers with fledgling reputations or was misused to question someone's credibility or integrity. Do the benefits to science outweigh the risks of false positives and potential misuse at this point? I am not sure how I feel about it right now, but I would be interested in reading other perspectives.

Similar questions and discussions