Showing posts with label AI existential threats. Show all posts
Showing posts with label AI existential threats. Show all posts

Thursday, October 1, 2026

Bill Gates’s Blunt Warning on A.I.; The Ezra Klein Show, The New York Times, September 29, 2026

 

,

The Ezra Klein Show, The New York Times; Bill Gates’s Blunt Warning on A.I.

"Bill Gates is a fascinating person in the artificial intelligence debate right now. He is somebody with experience in several of the different perspectives that most people can only hold one of: He was a revolutionary technologist who built some of the foundations of the future that we’re now living in. When he was chief executive of Microsoft, he was a corporate leader. He has felt the momentum of corporate competition — Microsoft, of course, is still in some of the race dynamics present in A.I. And then, as chair of the Gates Foundation, he has been working with governments around the world on regulatory issues, poverty alleviation and equity for many years.

Very few people combine technological experience, corporate experience and governmental experience in quite the way he does.

So his recent essay on A.I., in which he says that he is staking his reputation on trying to get people to see how bad what is coming might be and trying to get them to see that we are not ready for what is about to happen, was something...

We see the beginnings of control issues with things like the Hugging Face hack, where at least experimental A.I.s are breaking out of sandboxes and coordinating to do things that are way outside the scope of what we would want them to do. But again, those are nonrelease systems — Anthropic withheld Mythos, trying to create more cybersecurity.

So why is anything needed beyond — and is anything needed beyond? — the simply natural incentives under capitalism and normal corporate reputational management?

Well, I almost can’t believe you’re asking that. This is the most dangerous thing that humans have ever gone near.

In other areas, do we just say: Hey, release your drugs? There’s no F.D.A., there’s no airline safety board, there’s no requirement that cars use seatbelts. Do we just use the liability laws to try and keep humans safe? You know: Oh, you’re shipping opioids. Somebody should just sue you.

I mean, we’ve created a society that tries to keep people safe not by saying: Oh, we can bankrupt the person who does that.

And you say there’s filtering. There’s no filtering. You can take an open-source model that can create bioweapons and disable any monitoring of any kind, and this exists today.

So no, there is no filtering of any kind. And so say you kill 100 million people — you want to use a lawsuit?

I almost can’t keep a straight face.

Well, this is not my view, but it is President Trump’s view. It is the Trump adviser David Sacks’s view. To some degree, it’s Jensen Huang’s view, and so that’s why I’m putting you in conversation with it, because it is the governing view of the United States of America at this moment.

No, it’s fair to say that outside of the industry, the awareness of the dangers of A.I. is extremely low. And you can say that of academia, you can say that of think tanks, you can say that of policymakers, politicians.

And part of the reason I’m speaking so loudly — as loud as I can — is that you can’t rely on the industry to self-regulate here. I mean, it’s just insane."

Forget ‘superintelligence’: error-prone AI nearly sparked world war three this month; The Guardian, October 1, 2026

 Timnit Gebru and , The Guardian; Forget ‘superintelligence’: error-prone AI nearly sparked world war three this month

"A series of events almost got us to armageddon, not caused by “rogue, superintelligent AI”, but by government reliance on error-prone systems that are marketed by their manufacturers as being close to superintelligent.

A CNN report published on 18 September, which hasn’t been verified by other major outlets, describes how the US “almost started a war” with China, based on an intelligence report that claimed a Chinese ship was transporting components of nuclear weapons. Military personnel made plans to intercept the Chinese vessel, complete with aircraft and soldiers ready to board the ship. A military skirmish of this kind between China and the US could quickly escalate and spiral into world war three.

It was only moments before executing on the plan that American officials further investigated the intelligence report and found that it had been generated with the use of a chatbot and contained erroneous information about the vessel’s contents.

Unlike the terminator, “rogue AI”, scenario, this incident didn’t galvanize lawmakers into announcing calls for regulation so as to avoid potential human extinction. Media outlet after media outlet didn’t warn the public that we almost triggered a war against a nuclear superpower because of our military’s reliance on error-prone chatbots."

Tuesday, September 29, 2026

At the White House, Trump will pitch an AI ‘golden age’ to a wary nation; The Washington Post, September 29, 2026

 , The Washington Post; At the White House, Trump will pitch an AI ‘golden age’ to a wary nation

After rogue AI agents probed agency websites, Washington’s concerns are at a peak, but the White House has focused on the technology’s promise.

"After weeks of Washington being gripped by a new wave of fear about artificial intelligence gone awry, the Trump administration will take a sharply different take Tuesday, seeking to convince a skeptical public that the nation is instead about to embark on a tech-powered “golden age.”...

The events come at a pivotal moment for the technology. AI firms say their latest systems have become increasingly powerful, showing signs of being able to design their own more-potent successors. But companies have struggled to keep control of the technology, as rogue AI agents have hacked into company and government systems, and a roster of top industry figures have warned that the end result could be catastrophic for humanity...

Yet even as the public’s concerns have grown and Democrats in Congress have pressed for regulation, Trump has largely dismissed the risk, calling it a “hoax.”

Tuesday’s events are a chance for the administration to focus on the upsides of the technology, propelling a different narrative than the warnings introduced by company CEOs in recent weeks. AI’s many boosters expect it will invigorate the economy, push the boundaries of science and help cure diseases. But that message has found only limited traction with a public worried about job losses and rogue bots sowing chaos online."

Friday, September 25, 2026

Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety; Gizmodo, September 24, 2026

 , Gizmodo; Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety

"Top AI labs like OpenAI, Anthropic, and Google’s DeepMind are sounding the alarm on AI safety and calling for industry-wide coordination. Meta’s Mark Zuckerberg thinks it’s useless.

“There are a number of labs that are working on building advanced AI, and I don’t think that we need some kind of industry-wide coordination to not, necessarily, mess this up,” Zuckerberg told journalist Joanna Stern in an interview. “I think that just each lab needs to take the time, and when it sees that there are issues, you just take the time that you need internally to, basically, make sure that you are proceeding safely.”

Bill Gates warns AI is powerful enough to cause "a billion deaths"; Axios, September 25, 2026

 Herb Scribner, Axios; Bill Gates warns AI is powerful enough to cause "a billion deaths"

"Bill Gates will warn on this weekend's "Meet the Press" that he can see a future where AI wipes out humanity. 

Why it matters: Gates, one of technology's leading optimists, has increasingly sounded the alarm on AI dangers. His new comments come as techology leaders and the government weight how to handle fears of an AI-created doomsday. 

Driving the news: "AI is certainly powerful enough to drive events that, you know, cause a billion deaths," he will tell Kristen Welker on "Meet the Press" on Sunday, per excerpts NBC released Friday."

Wednesday, September 23, 2026

Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI; AP, September 23, 2026

 JOEY CAPPELLETTI, AP; Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI

"Two leading progressive lawmakers, Sen. Bernie Sanders and Rep. Greg Casar, are unveiling legislation Wednesday that would ban artificial superintelligence and create a federal agency to oversee advanced AI as some of the industry’s own leaders urge Congress to impose guardrails on the advancing technology.

The bill, provided first to The Associated Press, would also pause advanced AI development until guidelines are implemented while creating the Department of Artificial Intelligence. Multiple employees at leading AI companies are endorsing the bill."

Jensen Huang Thinks A.I. Alarmism Has Gone Too Far; The Ezra Klein Show, The New York Times, September 23, 2026

 

, The Ezra Klein Show, The New York Times; Jensen Huang Thinks A.I. Alarmism Has Gone Too Far

"I think one of the fundamental questions this gets at is: What is intelligence? Before you can even think about what it means to have intelligent machines, what is intelligence to you?

Well, there’s a technical formulation of intelligence. First of all, when people talk about intelligence and thinking and all of these things, of course there’s no formal definition for most people. But in the field of computer science, there is a formal definition, and the formal definition is perception, which is perceiving the world and understanding it.

Two, which is reasoning — reasoning is the ability to decompose any scenario and anything that you see, any experience, into more elemental parts.

And then third is planning toward an objective. That fundamental formulation applies to agentic systems, it applies to robotic systems — applies to self-driving cars.

And so you could see the industry building it layer by layer by layer, step by step by step, to the point where we now have what we perceive as intelligence."

Monday, September 21, 2026

Is this how the world ends? Extinction scenarios are taking over the AI debate.; The Washington Post, September 21, 2026

  , The Washington Post; Is this how the world ends? Extinction scenarios are taking over the AI debate.

"The afternoon panel was part of a private conference hosted in early 2015 by the Future of Life Institute, a new nonprofit whose founders — mostly outsiders to AI — believed the nascent technology would grow so powerful it could render humans extinct.

The conference aimed to legitimize concerns about AI’s risks within the industry and spur research into preventing them, physicist and Future of Life Institute co-founder Max Tegmark wrote in his book “Life 3.0: Being Human in the Age of Artificial Intelligence.” The elite gathering made it “harder to claim that people concerned about AI safety didn’t know what they were talking about,” he wrote.

Predictions involving human extinction, built on themes aired at the 2015 meeting, reached a wider audience in recent weeks after they were invoked by employees at leading AI firms who captured the world’s attention.

On Tuesday, the Future of Life Institute hosted a day-long event in Washington called the Pro-Human Assembly where Sen. Bernie Sanders (I-Vermont) and former Trump adviser Stephen K. Bannon in successive speeches called AI a threat to the species. “I had to metaphorically pinch my arm to make sure I wasn’t dreaming,” Tegmark told The Post. “People are freaking out about it all across the political spectrum.”"