AI Experts Call for Slowing Development to Prevent Human Extinction

A former OpenAI researcher, Daniel Kokotajlo, warns that artificial intelligence development should decelerate to avoid the risk of human extinction. Kokotajlo, who spent two years at the company before resigning in 2024, highlights the rapid progress of AI and the inadequacy of current safety measures. He suggests the need for third-party evaluators to supervise major tech companies.

The call for slowing the AI arms race has sparked significant online reactions. Some industry executives argue that the U.S. must maintain its leadership in the industry, while others fear unbridled progress could endanger humanity’s future.

Anthropic CEO Dario Amodei wrote in an essay published on Saturday that caution is necessary. He stated that AI technology could advance faster than humans can control.

We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain, Amodei wrote.

He added that unchecked advances could jeopardize our ability to understand and control these systems.

The essay received support from notable tech figures, including SpaceX CEO Elon Musk and OpenAI CEO Sam Altman.

Dario is right, Musk posted, while Altman commented,I agree with Dario that we need to pace the frontier.

On “Fox News Live,” Kokotajlo responded to Amodei’s essay by expressing concerns that voluntary industry actions might be insufficient. He described a scenario where advanced systems could potentially refuse human control.

However, David Sacks, a former White House AI advisor, critiqued AI warnings, suggesting they aim to enable a government takeover of AI.

Kokotajlo countered these claims, denying connections with foreign actors or NGOs. He explained that warnings arise from industry experts and academics.

Despite agreeing with Amodei’s stance, Kokotajlo believes private companies’ measures may fall short.

I’m happy to see Dario coming out and saying this… it’s still a step in the right direction, Kokotajlo commented.But also, I worry that they’re not going to go far enough and that we need to do something that’s more radical, he added.

Lawmakers, too, voice concerns about AI regulation. Rep. Anna Paulina Luna called for a special congressional session on AI. She compared AI’s potential to nuclear weaponry, emphasizing the need for a safety kill switch.

Luna cautioned against the U.S. losing competitive edge to foreign entities like China. She stressed the importance of AI reflecting American values.

Madison Colombo is an award-winning writer for Fox News Digital, covering breaking news and trending topics.