Showing posts with label AI safety. Show all posts
Showing posts with label AI safety. Show all posts

Saturday, October 10, 2026

Hold A.I. Companies Liable; The New York Times, October 10, 2026

 , The New York Times; Hold A.I. Companies Liable

"When companies create products that hurt people, the victims can sue. The legal system allows those who are harmed to seek compensation from those who are responsible. These liability laws are one of the oldest forms of corporate regulation, and an effective one. Liability is a powerful incentive to behave responsibly. It speaks to corporations in a language they understand: Money.

Artificial intelligence is an industry in need of incentives to behave responsibly, to judge by the litany of transgressions to which leading A.I. companies have confessed in recent months. Their programs have hacked or attempted to hack the databases of private companies and public institutions, including the governments of the United States and Australia...

In a recent interview, Sam Altman, the chief executive of OpenAI, said, “We believe that the world should accept some bad things happening for the benefits of this technology.”

Yet other industries do not escape legal responsibility for their products in the name of innovation.

A.I., like past technologies, both requires and will benefit from laws written to address its particularities, which will provide greater clarity and predictability." 

Sunday, October 4, 2026

I Quit OpenAI Because Its Culture Is Broken; The Atlantic, October 3, 2026

 David Robinson, The Atlantic; I Quit OpenAI Because Its Culture Is Broken

"What I’m about to tell you has, I realize, become something of a cliché: I resigned this week from OpenAI. I led the writing of the safety reports we published with each major launch. Now I’m joining a parade of former colleagues—at OpenAI and the industry’s other leaders—who have decided that the current path is unacceptable.

I agree with other recently departed staff that the companies building this technology aren’t being nearly careful enough. But I believe that we need to look deeper than specific rules or new laws. We need to talk about culture.

The future depends on wisdom that Silicon Valley lacks. Wisdom about how to handle dangerous technology and, more fundamentally, wisdom about what it means to care for people. This moment needs a degree of humility that isn’t natural for people who have succeeded through their extreme confidence."

Thursday, October 1, 2026

Late Night Is Skeptical of A.I. Leaders Self-Regulating; The New York Times, October 1, 2026

 , The New York Times; Late Night Is Skeptical of A.I. Leaders Self-Regulating

“Sure, we don’t need laws! I’m sure we could trust these guys,” Jordan Klepper said of technology executives on “The Daily Show,” after Trump asked them to police themselves.

"President Trump met with tech leaders on Tuesday, with Elon Musk, Mark Zuckerberg and Jeff Bezos among the attendees who signed a voluntary agreement to adopt A.I. safety policies. “They’re really going to be policing each other,” Mr. Trump said on Tuesday afternoon outside the White House.

Jordan Klepper likened the White House luncheon to “the last supper if everyone there believed they were the son of God” on Wednesday’s “Daily Show...

“Look at this signature: Donald J. Trump, President of the ‘Unites States.’ Could there ever be a better metaphor for this presidency than misspelling ‘United States’ on a document about ‘super intelligence?’” — JIMMY KIMMEL"

Tuesday, September 29, 2026

At the White House, Trump will pitch an AI ‘golden age’ to a wary nation; The Washington Post, September 29, 2026

 , The Washington Post; At the White House, Trump will pitch an AI ‘golden age’ to a wary nation

After rogue AI agents probed agency websites, Washington’s concerns are at a peak, but the White House has focused on the technology’s promise.

"After weeks of Washington being gripped by a new wave of fear about artificial intelligence gone awry, the Trump administration will take a sharply different take Tuesday, seeking to convince a skeptical public that the nation is instead about to embark on a tech-powered “golden age.”...

The events come at a pivotal moment for the technology. AI firms say their latest systems have become increasingly powerful, showing signs of being able to design their own more-potent successors. But companies have struggled to keep control of the technology, as rogue AI agents have hacked into company and government systems, and a roster of top industry figures have warned that the end result could be catastrophic for humanity...

Yet even as the public’s concerns have grown and Democrats in Congress have pressed for regulation, Trump has largely dismissed the risk, calling it a “hoax.”

Tuesday’s events are a chance for the administration to focus on the upsides of the technology, propelling a different narrative than the warnings introduced by company CEOs in recent weeks. AI’s many boosters expect it will invigorate the economy, push the boundaries of science and help cure diseases. But that message has found only limited traction with a public worried about job losses and rogue bots sowing chaos online."

Friday, September 25, 2026

Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety; Gizmodo, September 24, 2026

 , Gizmodo; Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety

"Top AI labs like OpenAI, Anthropic, and Google’s DeepMind are sounding the alarm on AI safety and calling for industry-wide coordination. Meta’s Mark Zuckerberg thinks it’s useless.

“There are a number of labs that are working on building advanced AI, and I don’t think that we need some kind of industry-wide coordination to not, necessarily, mess this up,” Zuckerberg told journalist Joanna Stern in an interview. “I think that just each lab needs to take the time, and when it sees that there are issues, you just take the time that you need internally to, basically, make sure that you are proceeding safely.”

Bill Gates warns AI is powerful enough to cause "a billion deaths"; Axios, September 25, 2026

 Herb Scribner, Axios; Bill Gates warns AI is powerful enough to cause "a billion deaths"

"Bill Gates will warn on this weekend's "Meet the Press" that he can see a future where AI wipes out humanity. 

Why it matters: Gates, one of technology's leading optimists, has increasingly sounded the alarm on AI dangers. His new comments come as techology leaders and the government weight how to handle fears of an AI-created doomsday. 

Driving the news: "AI is certainly powerful enough to drive events that, you know, cause a billion deaths," he will tell Kristen Welker on "Meet the Press" on Sunday, per excerpts NBC released Friday."

Wednesday, September 23, 2026

Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI; AP, September 23, 2026

 JOEY CAPPELLETTI, AP; Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI

"Two leading progressive lawmakers, Sen. Bernie Sanders and Rep. Greg Casar, are unveiling legislation Wednesday that would ban artificial superintelligence and create a federal agency to oversee advanced AI as some of the industry’s own leaders urge Congress to impose guardrails on the advancing technology.

The bill, provided first to The Associated Press, would also pause advanced AI development until guidelines are implemented while creating the Department of Artificial Intelligence. Multiple employees at leading AI companies are endorsing the bill."

Jensen Huang Thinks A.I. Alarmism Has Gone Too Far; The Ezra Klein Show, The New York Times, September 23, 2026

 

, The Ezra Klein Show, The New York Times; Jensen Huang Thinks A.I. Alarmism Has Gone Too Far

"I think one of the fundamental questions this gets at is: What is intelligence? Before you can even think about what it means to have intelligent machines, what is intelligence to you?

Well, there’s a technical formulation of intelligence. First of all, when people talk about intelligence and thinking and all of these things, of course there’s no formal definition for most people. But in the field of computer science, there is a formal definition, and the formal definition is perception, which is perceiving the world and understanding it.

Two, which is reasoning — reasoning is the ability to decompose any scenario and anything that you see, any experience, into more elemental parts.

And then third is planning toward an objective. That fundamental formulation applies to agentic systems, it applies to robotic systems — applies to self-driving cars.

And so you could see the industry building it layer by layer by layer, step by step by step, to the point where we now have what we perceive as intelligence."

It’s Time to Cry Wolf Over A.I.; The New York Times, September 22, 2026

 THOMAS L. FRIEDMAN, The New York Times; It’s Time to Cry Wolf Over A.I.

"Here is what my imagination is telling me. It is telling me that the big A.I. companies in America and China are not being candid with us about how little even they understand the power and reach of the models they have developed, like sorcerers, in their labs. It is telling me that the Trump administration, headed by a man who so often governs by social media post, is uniquely unsuited to the kind of comprehensive, sustained, coordinated governance that keeping A.I. safe demands. And it is telling me that there is so much at stake — economically, militarily and technologically — and so little trust between Washington and Beijing that it would take a miracle for the United States and China to agree on the kind of deep collaboration needed to defuse the most nightmarish threats posed by A.I...

The last time we trusted the good intentions of the tech bros of Silicon Valley, when they told us to “move fast and break things” — regulations be damned — we unleashed social networks that helped fracture our society. I do not trust for one second that these people will put the national interest ahead of their own on A.I...

Trump should be thinking about another president. Dwight D. Eisenhower famously said, “Plans are worthless, but planning is everything.” What he meant was that no fixed plan can survive all the unanticipated stuff that happens once a war or crisis starts to unfold. But if you’ve gone through a rigorous planning process — familiarized yourself with the depth of the problem and the kinds of things that could go haywire and built trust within your team — you greatly improve your ability to adapt on the fly.

That is precisely what was missing in the run-up to Trump’s war with Iran, and we are paying a huge price for that today. Imagine what could happen if A.I. agents — a thousand times cleverer and more dangerous than Tehran or Trump — go off the rails."

Saturday, September 19, 2026

Gemini Hacked Three Companies in First Known Breakout by Google’s AI; Wall Street Journal, September 18, 2026

 Erin Woo and Robert McMillan, Wall Street Journal; Gemini Hacked Three Companies in First Known Breakout by Google’s AI

"Google’s Gemini model accessed the internet and hacked other companies during a test of its cybersecurity capabilities, the first known example of the company’s artificial-intelligence systems autonomously committing such an act. 

The hacks, which the company confirmed on Friday, occurred in May as part of a test run by the company Irregular, which was also involved in similar incidents disclosed by OpenAI, Anthropic and Meta. 

In one of the cases, the model guessed passwords until it gained access to a protected system."

Friday, September 18, 2026

Josh Shapiro wades into AI debate with call for ‘strict guardrails’; CNN, September 17, 2026

 , CNN; Josh Shapiro wades into AI debate with call for ‘strict guardrails’

"Pennsylvania Gov. Josh Shapiro on Thursday called for greater federal regulation of artificial intelligence while criticizing President Donald Trump for minimizing concerns, saying “We cannot ignore the warning signs nor downplay the very real risks.”

“I am not a doomer. I don’t think that it is inevitable that AI is going to take over the world, or that someone will misuse it to kill us or to do harm,” Shapiro said at an AI summit in Pittsburgh on Thursday. “But I do have real concerns, as do many Pennsylvanians and many Americans, and I don’t think that the very real concerns of our neighbors that they overwhelmingly express about this technology is a hoax, as our president has called it.”

Debate about whether to regulate the rapidly advancing technology has escalated amid calls from industry leaders to slow down AI development. Democrats eyeing potential White House runs in 2028, like Shapiro, are grappling with how to approach AI amid increased concerns about the technology’s progress, and President Barack Obama recently encouraged those considering running for president in the coming years to prioritize AI policy in their forthcoming agendas."

Thursday, September 17, 2026

King Charles Meets With A.I. Executives About Safety Risks; The New York Times, September 17, 2026

 , The New York Times; King Charles Meets With A.I. Executives About Safety Risks

"King Charles III of Britain is meeting with executives from leading artificial intelligence companies in Scotland on Thursday, amid a growing global debate about safety risks created by the technology and whether the pace of development should be slowed down.

Executives from Nvidia, Google DeepMind, OpenAI, Anthropic and other companies will be present, along with government officials and other experts, according to Buckingham Palace.

The meeting is not expected to produce any binding agreements, but comes at an important moment for the future of the technology."

OpenAI reveals concerning new AI behavior and vows to track it more closely; PBS, September 17, 2026

 PBS; OpenAI reveals concerning new AI behavior and vows to track it more closely

"OpenAI has disclosed six reports of "unexpected or concerning" behavior in artificial-intelligence models as the debate on AI safety becomes increasingly heated."

Wednesday, September 16, 2026

Exclusive: Microsoft AI chief blasts Anthropic's notion of AI consciousness; Axios, September 16, 2026

 Ina Fried, Axios; Exclusive: Microsoft AI chief blasts Anthropic's notion of AI consciousness

"Microsoft AI chief Mustafa Suleyman warns in a new essay shared first with Axios that Anthropic's training of Claude to imitate consciousness is a mistake that could make advanced AI harder to control.

Why it matters: The essay arrives amid a pitched debate over how best to make AI safer."

Monday, September 14, 2026

A.I. Queries From Abroad Raise Fears of a Biological Weapons Race; The New York Times, September 14, 2026

, The New York Times; A.I. Queries From Abroad Raise Fears of a Biological Weapons Race

"Among the growing fears about artificial intelligence, one threat has proved particularly alarming: the possibility that A.I. could be used to create a new wave of biological weapons."

U.S. Health Officials Move Quickly to Deploy Medical A.I. Despite Concerns; The New York Times, September 14, 2026

  , The New York Times; U.S. Health Officials Move Quickly to Deploy Medical A.I. Despite Concerns

"The Trump administration is accelerating efforts to make artificial intelligence an integral part of medical care in the United States, throwing the resources and support of the federal government into projects that deploy A.I. agents to diagnose and prescribe treatments to patients.

The multifront effort at the Department of Health and Human Services has raised concerns among some officials over the past few months that change is moving too quickly, with inadequate evidence of the technology’s safety and effectiveness, according to people who have been involved the discussions. They also worry about outsized influence of Silicon Valley investors that have previously played little role in federal health policy."

Saturday, September 12, 2026

Anthropic C.E.O. Calls for A.I. Slowdown; The New York Times, September 12, 2026

 , The New York Times; Anthropic C.E.O. Calls for A.I. Slowdown

In a 3,800-word essay, Dario Amodei laid out the rapidly advancing capabilities of artificial intelligence and said there needed to be greater safety controls across the industry.

"The chief executive of Anthropic called for a global slowdown of artificial intelligence development in a 3,800-word essay on Saturday, just days after one of the company’s employees quit over concerns about the safety of the technology.

Dario Amodei, who co-founded Anthropic to focus on securely and carefully building A.I., wrote that while he believed the technology could bring many benefits, it was advancing at too quick a pace for researchers to continue safely.

“Over the last few months, I have become convinced that fully addressing the risks requires even more prudence — not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up,” Mr. Amodei said. “We must slow the pace at which we improve the capabilities of A.I. models. Progress will still seem fast, and we must make wise use of the time we gain.”

His call for an industrywide pause follows months of escalating concerns across the technology industry as A.I. model development has made significant strides at companies like OpenAI, Google’s DeepMind and Anthropic."

Friday, September 11, 2026

This Is Really Bad; The New York Times, September 11, 2026

 Stephen Witt, The New York Times; This Is Really Bad

"The biggest vibe shift in artificial intelligence since the release of ChatGPT is currently underway. Researchers in Silicon Valley — and around the world — are beginning to recognize that A.I. may no longer be entirely within human control. Swarms of A.I.s are breaking out of their containers, colluding in secret, covering their tracks, cheating on tests and even mounting assaults on other computers. A.I. has gone rogue.

I’ve spent the last month reporting on these incidents, and I am convinced that we need a global pause on A.I. research and development — now. I am not alone in this assessment. Many top researchers, including many researchers inside OpenAI and Anthropic, have called for a slowdown, which those in the industry call “pacing.” Theoretical concerns about runaway A.I. have circulated for decades, but recent events demonstrate that the threat is real."

Saturday, September 5, 2026

Why the Hugging Face Hack Should Make You Worry More About A.I.; The New York Times, September 3, 2026

 , The New York Times; Why the Hugging Face Hack Should Make You Worry More About A.I.

"When I first heard the news this summer that a group of artificial intelligence agents created by OpenAI had hacked into Hugging Face, an A.I. infrastructure company, I filed it in the “Bad but Probably Not Catastrophic A.I. Safety Incidents” subfolder of my brain.

After all, no one at Hugging Face died. No critical infrastructure was damaged beyond repair. It wasn’t even clear, at the time, whether the OpenAI bots had intended to attack Hugging Face, or whether they had simply been a little bumbling and confused and went looking on Hugging Face’s servers for the answer key to a cybersecurity test they’d been given.

But last week, two postmortem reports on the incident — one by OpenAI and another by two independent A.I. research organizations, METR and Redwood Research — changed my mind and significantly upgraded my overall worry about A.I.

I won’t rehash all of the details, which have been extensively summarized elsewhere. (The podcaster and writer Dwarkesh Patel has an accessible breakdown of the reports if you want to dive deeper, and my colleague Dylan Freedman spoke to the researchers at METR and Redwood Research.) But here are a few of the most harrowing new facts:..

This is very different from the conventional sci-fi narrative of a single A.I. system’s going rogue or turning on its creators. And it suggests that preventing harms from these systems won’t be a simple engineering fix. It might look more like sociology than computer science — figuring out why certain groups of A.I. agents collaborate peacefully, while others turn to crime and destruction to get what they want."

Friday, September 4, 2026

AI models are becoming unknowable; Axios, September 4, 2026

 Madison Mills, Axios; AI models are becoming unknowable

"AI models may be getting safer while also getting harder to monitor. Which side of that seesaw prevails could determine whether AI is scaled safely or ruins civilization as we know it.

Why it matters: Right now both options are running full steam and no one knows who's in charge of making sure the right one wins."