3 days agoWe need a chat about ChatGPTThere’s a quote attributed to Ernest Rutherford: “That which is not measurable is not science. That which is not physics is stamp collecting”. I think his point was that a lot of scientific work is just documenting things. In Rutherford’s day, there was a lot of exciting new creative work…Artificial Intelligence5 min readArtificial Intelligence5 min read
Nov 28, 2022Video: APIs for Papermill detection (ConTech API Series)Recently, I gave a presentation on the APIs for Papermill Detection offered by Clear Skies Ltd. I also touch on a newer service called the Clear Skies Standard Report. More on that in future posts… :) Here’s the video: Would you like to know more? There are a few more presentations coming up: I’ll be…Research Integrity1 min readResearch Integrity1 min read
Oct 31, 2022(The?) 3 kinds of papermillsTL;DR: Join me at ConTech Live to hear about a recent project with Open Credo to see if we could detect unusual co-authorships in a dataset created by Anna Abalkina. Sign up here! Papermilling has a few definitions which you see here and there. Sometimes it’s “organised manipulation of the…Academic Publishing3 min readAcademic Publishing3 min read
Oct 17, 2022How to use the Papermill Alarm APIAlso… what is an API? — The Papermill Alarm API, is a service which you can send some article metadata to and which will return an alert telling you if the paper looks like past papermill-products. Anyone can use it, but it definitely helps to have the support of an IT or data professional. (By the…Research Integrity4 min readResearch Integrity4 min read
Sep 12, 2022Papermills in peer-reviewDissecting a joke is a bit like dissecting a frog. No one needs to know what’s inside and the frog dies. — Jimmy Carr Last week, a paper I wrote on the subject of peer-review fraud was published in the journal Scientometrics (free link here, preprint here). It was an…Academic Publishing5 min readAcademic Publishing5 min read
Aug 23, 2022The Papermill Alarm: Patterns in PubMedThis post is about The Papermill Alarm: an API for detecting potential papermill-products. There’s a field of study called ‘stylometry’ where we look at the statistical properties of someone’s writing and use that to model their ‘style’. People write in idiosyncratic ways. So, for example, I often start sentences with…Academic Publishing4 min readAcademic Publishing4 min read
Aug 5, 2022Patterns and Evidence (and how to find papermills before peer-review)I once saw a brilliant presentation about how simple data analysis can detect credit card fraud**. The presentation showed a pattern in how people use their credit cards. Given a large number of people who had been victims of credit card fraud, this pattern showed there was just 1 store…Research Integrity3 min readResearch Integrity3 min read
Jul 25, 2022How to find all the papermills (step 1)The first time I flew over the North Atlantic was quite an experience. Through the clouds, I could see some little white boats out sailing in the sea. It was puzzling: from 30,000 feet, those boats must have been huge for me to be able to see them at all…Research Integrity4 min readResearch Integrity4 min read
Jun 22, 2022Papermills: What’s wrong with duplicate submission?You want to submit a paper to a journal for consideration. It takes, say, 3 months on average for a paper to go through peer-review, so if your paper gets rejected, you’ve lost 3 months of your time. Wouldn’t it be better to hedge your bets? Submit the paper to…Peer Review4 min readPeer Review4 min read
Jun 14, 2022Hindsight is a wonderful thingLooking back, there’s a theme in a lot of misconduct cases which is duplication. Again and again, we see the same thing in 2 different places and it’s either evidence of misconduct or, at least a hint of where to look for it. I’ve seen pairs of papers, with different…Peer Review4 min readPeer Review4 min read