Matteo Wong, The Atlantic; The Blog Post That Set the AI World on Fire
"For the past 24 hours, Silicon Valley has been obsessed with a 26,000-word blog post by the AI researcher Nick Cammarata. The document has been called the “the most important essay,” “the most important result,” and “the single best piece of news” of the year, or in the history of AI research—or, perhaps, ever. Even OpenAI CEO Sam Altman lauded it. Cammarata makes a series of bold, almost astonishing claims about the nature of AI that, if true, would upend some of his industry’s basic assumptions about the very thing it is building. And after months of AI-hacking sprees and mounting public backlash against the industry, many people see Cammarata as offering a glimmer of hope when it comes to not just understanding but also controlling the technology being unleashed on the world.
Boiled down, Cammarata’s main contention is that generative-AI models are not actually black boxes, contrary to the common perception that these systems are so big and labyrinthine as to be nearly impenetrable. In fact, Cammarata argues, there is a relatively clear path toward understanding them. If that’s the case, the material significance could be tremendous: It would provide a way to map AI models’ inner workings and, in turn, perhaps prevent them from wreaking all sorts of harm—autonomously hacking companies and sovereign nations, encouraging users’ delusions, appearing to deceive AI researchers themselves. There is an entire field of research, called “mechanistic interpretability,” devoted to the study of just this."
