BENJAMIN MAZER, The Atlantic; Scientific Publishing Is a Joke
An XKCD comic—and its many remixes—perfectly captures the absurdity of academic research.
"“The meme hits the right nerve,” says Vinay Prasad, an associate epidemiology professor and a prominent critic of medical research. “Many papers serve no purpose, advance no agenda, may not be correct, make no sense, and are poorly read. But they are required for promotion.” The scholarly literature in many fields is riddled with extraneous work; indeed, I’ve always been intrigued by the idea that this sorry outcome was more or less inevitable, given the incentives at play. Take a bunch of clever, ambitious people and tell them to get as many papers published as possible while still technically passing muster through peer review … and what do you think is going to happen? Of course the system gets gamed: The results from one experiment get sliced up into a dozen papers, statistics are massaged to produce more interesting results, and conclusions become exaggerated. The most prolific authors have found a way to publish more than one scientific paper a week. Those who can’t keep up might hire a paper mill to do (or fake) the work on their behalf...
A staggering 200,000 COVID-19 papers have already been published, of which just a tiny proportion will ever be read or put into practice. To be fair, it’s hard to know in advance which data will prove most useful during an unprecedented health crisis. But pandemic publishing has only served to exacerbate some well-established bad habits, Michael Johansen, a family-medicine physician and researcher who has criticized many studies as being of minimal value, told me. “COVID publications appear to be representative of the literature at large: a few really important papers and a whole bunch of stuff that isn’t or shouldn’t be read,” he said."
