, IEEE Spectrum; I Used AI to Fake a Scientific Paper. Here’s What Happened: My experiment with an IEEE journal revealed AI’s threats to scholarly publishing
"According to all reports, academic publishing is drowning in what has come to be called AI slop: low-quality, mass-produced content generated with AI. By 2025, an estimated 57 percent of all published academic articles exhibited detectable evidence of large language model (LLM) influence, a massive jump from 12 percent in 2023. What’s more, over 12 percent of Nature Communicationsreviews were found to be completely AI-generated in 2025.
Given that for every 40 papers showing statistical evidence of AI usage in 2025, only one formally disclosed it, these figures likely grossly underestimate LLM involvement today. Of course, evidence of AI use doesn’t necessarily mean a paper is slop. But some estimates suggest that hundreds of thousands of fake, often AI-generated, publications are now produced annually.
“It’s not just the [scientific] record under threat, it’s science as a whole,” warns Amanda Sulicz, IEEE’s research-integrity manager. “AI slop is completely eroding trust in science and every scientific process that we’ve worked for centuries to create.”
Yet statistics and statements claiming that the problem is big—perhaps even existential for science—don’t really get the message across. Just how easy is it to use AI to create a convincing but completely fake paper? And without adding even more to the burden on stretched peer reviewers, who do this work on a volunteer basis, do publishers have the tools to keep AI slop out of the scientific record?
Borrowing from the idea of “vibe coding,” in which programmers use natural-language prompts to generate code, I decided to “vibe-research” a made-up paper by prompting LLMs to generate hypotheses, code, and text with minimal human input. Then I asked Jenny Mahoney, managing editor of the multidisciplinary and open-access journal IEEE Access, if we could war-game an attempt to sneak my AI-generated monstrosity past her journal’s defenses. She and IEEE kindly agreed."
