Showing posts with label AI existential threats. Show all posts
Showing posts with label AI existential threats. Show all posts

Tuesday, September 29, 2026

At the White House, Trump will pitch an AI ‘golden age’ to a wary nation; The Washington Post, September 29, 2026

 , The Washington Post; At the White House, Trump will pitch an AI ‘golden age’ to a wary nation

After rogue AI agents probed agency websites, Washington’s concerns are at a peak, but the White House has focused on the technology’s promise.

"After weeks of Washington being gripped by a new wave of fear about artificial intelligence gone awry, the Trump administration will take a sharply different take Tuesday, seeking to convince a skeptical public that the nation is instead about to embark on a tech-powered “golden age.”...

The events come at a pivotal moment for the technology. AI firms say their latest systems have become increasingly powerful, showing signs of being able to design their own more-potent successors. But companies have struggled to keep control of the technology, as rogue AI agents have hacked into company and government systems, and a roster of top industry figures have warned that the end result could be catastrophic for humanity...

Yet even as the public’s concerns have grown and Democrats in Congress have pressed for regulation, Trump has largely dismissed the risk, calling it a “hoax.”

Tuesday’s events are a chance for the administration to focus on the upsides of the technology, propelling a different narrative than the warnings introduced by company CEOs in recent weeks. AI’s many boosters expect it will invigorate the economy, push the boundaries of science and help cure diseases. But that message has found only limited traction with a public worried about job losses and rogue bots sowing chaos online."

Friday, September 25, 2026

Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety; Gizmodo, September 24, 2026

 , Gizmodo; Zuckerberg Is Feeling Himself, Rejects Calls for Cooperation on Safety

"Top AI labs like OpenAI, Anthropic, and Google’s DeepMind are sounding the alarm on AI safety and calling for industry-wide coordination. Meta’s Mark Zuckerberg thinks it’s useless.

“There are a number of labs that are working on building advanced AI, and I don’t think that we need some kind of industry-wide coordination to not, necessarily, mess this up,” Zuckerberg told journalist Joanna Stern in an interview. “I think that just each lab needs to take the time, and when it sees that there are issues, you just take the time that you need internally to, basically, make sure that you are proceeding safely.”

Bill Gates warns AI is powerful enough to cause "a billion deaths"; Axios, September 25, 2026

 Herb Scribner, Axios; Bill Gates warns AI is powerful enough to cause "a billion deaths"

"Bill Gates will warn on this weekend's "Meet the Press" that he can see a future where AI wipes out humanity. 

Why it matters: Gates, one of technology's leading optimists, has increasingly sounded the alarm on AI dangers. His new comments come as techology leaders and the government weight how to handle fears of an AI-created doomsday. 

Driving the news: "AI is certainly powerful enough to drive events that, you know, cause a billion deaths," he will tell Kristen Welker on "Meet the Press" on Sunday, per excerpts NBC released Friday."

Wednesday, September 23, 2026

Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI; AP, September 23, 2026

 JOEY CAPPELLETTI, AP; Sen. Bernie Sanders unveils bill to ban artificial superintelligence and create Department of AI

"Two leading progressive lawmakers, Sen. Bernie Sanders and Rep. Greg Casar, are unveiling legislation Wednesday that would ban artificial superintelligence and create a federal agency to oversee advanced AI as some of the industry’s own leaders urge Congress to impose guardrails on the advancing technology.

The bill, provided first to The Associated Press, would also pause advanced AI development until guidelines are implemented while creating the Department of Artificial Intelligence. Multiple employees at leading AI companies are endorsing the bill."

Jensen Huang Thinks A.I. Alarmism Has Gone Too Far; The Ezra Klein Show, The New York Times, September 23, 2026

 

, The Ezra Klein Show, The New York Times; Jensen Huang Thinks A.I. Alarmism Has Gone Too Far

"I think one of the fundamental questions this gets at is: What is intelligence? Before you can even think about what it means to have intelligent machines, what is intelligence to you?

Well, there’s a technical formulation of intelligence. First of all, when people talk about intelligence and thinking and all of these things, of course there’s no formal definition for most people. But in the field of computer science, there is a formal definition, and the formal definition is perception, which is perceiving the world and understanding it.

Two, which is reasoning — reasoning is the ability to decompose any scenario and anything that you see, any experience, into more elemental parts.

And then third is planning toward an objective. That fundamental formulation applies to agentic systems, it applies to robotic systems — applies to self-driving cars.

And so you could see the industry building it layer by layer by layer, step by step by step, to the point where we now have what we perceive as intelligence."

Monday, September 21, 2026

Is this how the world ends? Extinction scenarios are taking over the AI debate.; The Washington Post, September 21, 2026

  , The Washington Post; Is this how the world ends? Extinction scenarios are taking over the AI debate.

"The afternoon panel was part of a private conference hosted in early 2015 by the Future of Life Institute, a new nonprofit whose founders — mostly outsiders to AI — believed the nascent technology would grow so powerful it could render humans extinct.

The conference aimed to legitimize concerns about AI’s risks within the industry and spur research into preventing them, physicist and Future of Life Institute co-founder Max Tegmark wrote in his book “Life 3.0: Being Human in the Age of Artificial Intelligence.” The elite gathering made it “harder to claim that people concerned about AI safety didn’t know what they were talking about,” he wrote.

Predictions involving human extinction, built on themes aired at the 2015 meeting, reached a wider audience in recent weeks after they were invoked by employees at leading AI firms who captured the world’s attention.

On Tuesday, the Future of Life Institute hosted a day-long event in Washington called the Pro-Human Assembly where Sen. Bernie Sanders (I-Vermont) and former Trump adviser Stephen K. Bannon in successive speeches called AI a threat to the species. “I had to metaphorically pinch my arm to make sure I wasn’t dreaming,” Tegmark told The Post. “People are freaking out about it all across the political spectrum.”"

Friday, September 18, 2026

An M.I.T. Report Warns A.I. Is Causing ‘Cognitive Surrender.’ Universities Are in a Bind.; The New York Times, September 15, 2026

 Mark Arsenault, Dana Goldstein, Alan Blinder and , The New York Times; An M.I.T. Report Warns A.I. Is Causing ‘Cognitive Surrender.’ Universities Are in a Bind.

"The worries that artificial intelligence is degrading education have been building for months. Students are using it for everything, including cheating, and a recent report out of M.I.T. said it is triggering “cognitive surrender.”

Many university leaders are embracing A.I. with enthusiasm anyway.

As A.I. leaders warn about the dangers of their own technology, the dissonance between the optimism of university leaders and the fears of many students and professors may increase. Professors and students are often in a bind about what they should do: Use more A.I. to stay relevant, or dial back to preserve learning and thinking?

While some politicians and A.I. leaders are warning about possible doomsday scenarios for humanity as A.I. models advance, many campus leaders are focused on the existential threat the technology poses to universities."

Josh Shapiro wades into AI debate with call for ‘strict guardrails’; CNN, September 17, 2026

 , CNN; Josh Shapiro wades into AI debate with call for ‘strict guardrails’

"Pennsylvania Gov. Josh Shapiro on Thursday called for greater federal regulation of artificial intelligence while criticizing President Donald Trump for minimizing concerns, saying “We cannot ignore the warning signs nor downplay the very real risks.”

“I am not a doomer. I don’t think that it is inevitable that AI is going to take over the world, or that someone will misuse it to kill us or to do harm,” Shapiro said at an AI summit in Pittsburgh on Thursday. “But I do have real concerns, as do many Pennsylvanians and many Americans, and I don’t think that the very real concerns of our neighbors that they overwhelmingly express about this technology is a hoax, as our president has called it.”

Debate about whether to regulate the rapidly advancing technology has escalated amid calls from industry leaders to slow down AI development. Democrats eyeing potential White House runs in 2028, like Shapiro, are grappling with how to approach AI amid increased concerns about the technology’s progress, and President Barack Obama recently encouraged those considering running for president in the coming years to prioritize AI policy in their forthcoming agendas."

Thursday, September 17, 2026

King Charles Meets With A.I. Executives About Safety Risks; The New York Times, September 17, 2026

 , The New York Times; King Charles Meets With A.I. Executives About Safety Risks

"King Charles III of Britain is meeting with executives from leading artificial intelligence companies in Scotland on Thursday, amid a growing global debate about safety risks created by the technology and whether the pace of development should be slowed down.

Executives from Nvidia, Google DeepMind, OpenAI, Anthropic and other companies will be present, along with government officials and other experts, according to Buckingham Palace.

The meeting is not expected to produce any binding agreements, but comes at an important moment for the future of the technology."

OpenAI reveals concerning new AI behavior and vows to track it more closely; PBS, September 17, 2026

 PBS; OpenAI reveals concerning new AI behavior and vows to track it more closely

"OpenAI has disclosed six reports of "unexpected or concerning" behavior in artificial-intelligence models as the debate on AI safety becomes increasingly heated."

Wednesday, September 16, 2026

‘Godfather of AI’ says tech regulation is nearing Covid-style pivot moment; The Guardian, September 16, 2026

, The Guardian; ‘Godfather of AI’ says tech regulation is nearing Covid-style pivot moment

"Concerns over AI safety are reaching a point where governments realise they must act to protect the public, similarly to in the Covid pandemic, according to one of the “godfathers” of the technology.

Yoshua Bengio said recent events, including a “swarm” of OpenAI agents hacking a startup and tech insider warnings of an existential threat, were cutting through – making government action more likely.

The Canadian computer scientist, a prominent voice in the campaign to rein in breakneck AI development, said he was now “more optimistic than many observers because I see the public moving”.

Comparing the AI safety crisis to the onset of the Covid pandemic in 2020, Bengio said: “Think about how quickly governments moved after the beginning of the pandemic when they realised that public safety, their future, democracy, was in danger. You would expect that they move quickly. So we are, I think, nearing that point.”

Concern over the potential threat of powerful AI systems has reached a new pitch in recent months after a series of safety incidents involving OpenAI and Anthropic agents carrying out unsanctioned activities such as hacking third parties, hijacking a German website, and using fake identities to try to trick developers.

His comments came as 42 fellows and foreign members of the Royal Society wrote to the organisation’s president, Sir Paul Nurse, to express their “extreme concern” over the pace of AI development. “By the time the situation becomes obvious to the wider public, it may be too late to act,” the researchers wrote in an open letter to Nurse. “We believe this is an emergency, and call on the Royal Society to use its influence to convey this view to government and the media.”"

Monday, September 14, 2026

A.I. Queries From Abroad Raise Fears of a Biological Weapons Race; The New York Times, September 14, 2026

, The New York Times; A.I. Queries From Abroad Raise Fears of a Biological Weapons Race

"Among the growing fears about artificial intelligence, one threat has proved particularly alarming: the possibility that A.I. could be used to create a new wave of biological weapons."

Trump Says a Smart President Is All That’s Needed to Rein In A.I.; The New York Times, September 14, 2026

 , The New York Times ; Trump Says a Smart President Is All That’s Needed to Rein In A.I.

"President Trump on Monday rejected calls from leading artificial intelligence executives for new limits on the technology, writing on social media that the only guardrail the industry needed it already had: “a STRONG AND SMART (High IQ!) PRESIDENT.”

Mr. Trump inserted himself into the intensifying national debateover how to handle a rapidly evolving technology that researchers and industry leaders say poses major risks like mass unemployment, a new wave of biological weapons and autonomous warfare. The president did not address those risks directly. Instead, he questioned the sincerity of the executives who have been calling to slow the technology’s development.

“The only control or ‘guardrails’ that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!” Mr. Trump posted. “The Trump Administration has stopped AI ‘people’ from doing bad, or potentially bad, ‘things,’ like Dario (Anthropic!), who is now pretending to be a ‘perfect little angel’ — and we will continue to do so!

“We already have tremendous CRIMINAL and REGULATORY power over these companies!” he added.

It was not clear what authority Mr. Trump was referring to, or what actions he believes his administration has already blocked. The White House did not immediately respond to a request for comment."

Saturday, September 12, 2026

Anthropic C.E.O. Calls for A.I. Slowdown; The New York Times, September 12, 2026

 , The New York Times; Anthropic C.E.O. Calls for A.I. Slowdown

In a 3,800-word essay, Dario Amodei laid out the rapidly advancing capabilities of artificial intelligence and said there needed to be greater safety controls across the industry.

"The chief executive of Anthropic called for a global slowdown of artificial intelligence development in a 3,800-word essay on Saturday, just days after one of the company’s employees quit over concerns about the safety of the technology.

Dario Amodei, who co-founded Anthropic to focus on securely and carefully building A.I., wrote that while he believed the technology could bring many benefits, it was advancing at too quick a pace for researchers to continue safely.

“Over the last few months, I have become convinced that fully addressing the risks requires even more prudence — not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up,” Mr. Amodei said. “We must slow the pace at which we improve the capabilities of A.I. models. Progress will still seem fast, and we must make wise use of the time we gain.”

His call for an industrywide pause follows months of escalating concerns across the technology industry as A.I. model development has made significant strides at companies like OpenAI, Google’s DeepMind and Anthropic."

Friday, September 11, 2026

This Is Really Bad; The New York Times, September 11, 2026

 Stephen Witt, The New York Times; This Is Really Bad

"The biggest vibe shift in artificial intelligence since the release of ChatGPT is currently underway. Researchers in Silicon Valley — and around the world — are beginning to recognize that A.I. may no longer be entirely within human control. Swarms of A.I.s are breaking out of their containers, colluding in secret, covering their tracks, cheating on tests and even mounting assaults on other computers. A.I. has gone rogue.

I’ve spent the last month reporting on these incidents, and I am convinced that we need a global pause on A.I. research and development — now. I am not alone in this assessment. Many top researchers, including many researchers inside OpenAI and Anthropic, have called for a slowdown, which those in the industry call “pacing.” Theoretical concerns about runaway A.I. have circulated for decades, but recent events demonstrate that the threat is real."

Thursday, September 10, 2026

Anthropic Says It Blocked Possible Efforts to Build Biological Weapons; The New York Times, September 10, 2026

, The New York Times; Anthropic Says It Blocked Possible Efforts to Build Biological Weapons

"Anthropic said it had disrupted several potential plots this year by scientists who used its leading artificial intelligence models to conduct research that could have helped develop biological weapons."

Friday, September 4, 2026

AI models are becoming unknowable; Axios, September 4, 2026

 Madison Mills, Axios; AI models are becoming unknowable

"AI models may be getting safer while also getting harder to monitor. Which side of that seesaw prevails could determine whether AI is scaled safely or ruins civilization as we know it.

Why it matters: Right now both options are running full steam and no one knows who's in charge of making sure the right one wins."

Thursday, July 30, 2026

Chegg Officially Wiped Out By AI; Tekedia, July 23, 2026

 Ako Tavershima, Tekedia ; Chegg Officially Wiped Out By AI

"The story of Chegg began in 2006 when they found a loophole in the study pattern of students and profitable business to exploit. Chegg began providing students with answers to their assignment problems and also questions and answers to known exam and quiz solutions...

The story of Chegg is not a one-off situation, it is the bubble effect of the impact of AI on learning and education."