Peer Review by AI?

An interesting article by Janne Hukkinen in Wired has introduced me to a new concept, peer review conducted by artificial intelligence!board-2181407_1920

The article argues it is risky business, and I agree. While it can streamline the process and lead to faster publishing, I seriously doubt an algorithm could review a paper to the same quality as a human expert. Nuances would be missed. As the author states it would fail to consider values, “such as ranking two scientifically equal texts on the basis of their social relevance”. Hukkinen also tells a story akin to Hal in 2001: a Space Odyssey, where a rogue program sent “terse letters” without the knowledge of the company.

Clearly there is space for computer assistance, searching for plagiarism and obvious errors for one. It can immediately discount some manuscripts based on particular criteria. But peer review done solely by AI? I am sceptical. Of course, I suppose people are sceptical of every new technological development. Perhaps in the future it will simply be accepted as the norm.

The article poses some interesting questions for the future of publishing and science, and is well worth a read. The possibilities really are endless…