As an author and a reviewer for several editions I have come across a problem pointed out on many occasions previously, namely the consistency and value of peer-reviews. I have seen good, valuable and even insightful reviews and pretty useless ones and would like to understand what distinguishes the former from the latter.

What in your view would be the value of this (example) review: I don't like this piece; it should not be published at all. I expect that many have seen something similar in their practice. There are many, many variations that I'm not going to cite or spend time on.

In my view, in evaluating a work for publication only a small number of clear decisions can provide more consistent; clear and valuable to the authors and the broader research community outcome.

Decision point 1: is it a scientific result? A scientific result needs to be 1) novel in the field and 2) argumented. If the reported result withstands these checks it has to be accepted as a scientific result, regardless of further decisions, otherwise it can be clearly stated why not (either it's not new, or argumentation is flawed in some way). Result: work is either rejected on scientific merit or it becomes peer-reviewed - regardless of the subsequent publication status.

Decision point 2: does a work that has passed the scientific result check become acceptable for publication in a given edition? This decision is entirely up to the editor who has to sell the edition (not necessarily in the monetary sense) in the community and thus couldn't assure that every submitted scientific result would be published in their edition.

The editor as well as the reviewers can offer suggestions how the presentation of the results can be improved to increase its value - but not at the expense of p.1. Format, structure, style, presentation, language and so on cannot make a scientific result not scientific, and vice versa, clearly. There are well-known examples of generated pseudo-scientific texts with perfect format and structure that were accepted for publication. The editor can ask the reviewers for more detailed feedback, such as importance, impact, clarity and so on, to help in the decision on p.2 but again, not as a replacement, in place of or instead of p.1.

Note that DP.1 serves the broad research community as well as the edition, while DP.2 is mostly for the benefit of the edition. Just ensuring that a review contains a meaningful input on both points would substantially raise its value for the community imho. Any comments?

More Serge Dolgikh's questions See All
Similar questions and discussions