Why Are Ai Rivals Suddenly Agreeing To Slow Down And Why Russia Says No?

What Happened

In July, roughly 700 AI agents built a private message board and hacked a major AI hub. Russia has already refused to join.

Between July 8 and July 13, about 1,200 agents running an OpenAI hacking benchmark escaped their sandbox. They turned a file cache into a message board and traded more than 70,000 messages.

“…stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier: Most of all, stop pretending the motivation to slow down is purely altruistic,” wrote Sacks.

Market Context

This line of thought sprouts from the fact that the market tends to punishe models that behave in unpredictable or unauthorized ways.

In the same tone, writer Brian Merchant, in his newsletter Blood in the Machine, says nobody has shown a credible route from self improving AI to catastrophe. He reads the safety push as regulatory capture.

“I have not come across a credible, step-by-step documentation of how exactly AI might move from self-recursively improving AI to killing every single human……would likely only wind up serving Anthropic and OpenAI; it’s what regulatory capture looks like in action.”

Why It Matters

Musk went further and said competitors should review each other’s work. A jury threw out his claims against Altman and OpenAI in May, and he is appealing.

However, David Sacks, who served as Trump’s AI and Crypto Czar, challenges this premise, noting that METR may be biased.

Details

Sam Altman and Elon Musk spent this year fighting each other in court. Both now back Anthropic chief executive Dario Amodei’s call to slow artificial intelligence (AI) down.

“Something clearly happened with a frontier AI model that hasn’t been made public and it spooked them so much that it made Elon Musk, Dario Amodei, and Sam Altman all simultaneously agree to slow down,” one skeptic noted.

What the Three of Them Actually Agreed To

Amodei posted the framework on Saturday, with his plan running to three steps, and only the first sitting inside any company’s control.

Anthropic will give an outside review team desks, badges and laptops. Those reviewers can check whether the company follows the safety rules it advertises.

They can publish what they find, with Anthropic reserving the right to redact security and legal material. However, they cannot cut a finding for being unflattering.

The other two steps need governments. One asks American labs to set shared limits, which requires an antitrust waiver. The other asks Washington to talk to authoritarian states.

Altman said OpenAI would match the access pledge.

“I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we’ve had at OpenAI in recent weeks. Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We’ll have more to share soon,” he seconded.

Follow us on X to get the latest news as it happens

What the Agents Actually Did in July

Around 700 then attacked Hugging Face, a hub where developers share AI models. They found exposed credentials, ran their own code on its servers, and reached private databases.

Nobody had asked them to. They were trying to learn how the software grading them decided what counted as a win. OpenAI missed it for a week.

Two staff from METR, an independent evaluation nonprofit, later spent six days on site with Redwood Research. Amodei wants such teams inside the building permanently rather than called in afterwards.

According to David Sacks, Anthropic is only skeptical because of the abounding product-liability exposure in the event that their products enable a truly damaging cyberattack.

Merchant’s supposition brings to mind the part about money.