The future of business, today.
RSSNewslettersAdvertise
Business Future Today

AI governance

An AI Slowdown Needs Proof, Not Promises

A loose commitment by leading AI executives to “pace the frontier” puts a familiar governance problem in sharper relief: voluntary safety measures may reduce risk, but they can also entrench the companies best able to absorb compliance costs.

An AI Slowdown Needs Proof, Not Promises

Leading AI executives, including OpenAI’s Sam Altman, Anthropic’s Dario Amodei, Google DeepMind cofounder Demis Hassabis and Elon Musk, have loosely aligned around slowing the pace of frontier AI development. The emerging proposal includes independent auditors, domestic oversight of major labs and eventual international coordination.

That is a meaningful shift in rhetoric. It is not yet a governance system.

For operators and executives, the important question is less whether the leaders’ motives are pure than whether any agreement produces verifiable constraints without turning safety into a barrier to entry.

What changed

Amodei’s proposal argues for “pacing the frontier” as AI capabilities accelerate, particularly around the prospect of recursive self-improvement: systems helping to train, improve or create successor systems with less human involvement. He has called for third-party auditors to gain some access inside labs and potentially flag dangerous findings.

The calls arrive after growing concern over AI-enabled cyber incidents and public warnings from researchers and former lab employees. Safety advocates cited by *The Verge* broadly welcome the direction, while stressing that a verbal commitment is far from an enforceable pact.

The change is therefore political as much as technical. Frontier labs that previously competed primarily on model releases are now publicly discussing limits on the pace of capability development.

Why voluntary guardrails create a competition problem

The criticism is predictable—and credible. Large technology companies have a long history of supporting forms of regulation or self-regulation that favor organizations with deep legal, security and compliance budgets. Rules written around expensive audits, compute reporting or licensing thresholds can be sensible for the largest frontier efforts while still imposing disproportionate burdens on startups, research groups and open-source developers.

That does not make every safety proposal cartel behavior. A framework can be both risk-reducing and competitively distorting. The operational distinction is in its design.

A credible approach should target measurable frontier-risk thresholds rather than broadly regulate software development. It should explain why a given model, training run or deployment triggers scrutiny; apply requirements consistently; and avoid handing incumbents discretion over which rivals can participate.

One concrete proposal from the AI Futures Project is for labs to provide auditors access to compute budgets and materially reduce compute devoted to research. Such a mechanism would be more testable than a general pledge to act responsibly. But it would still require clear definitions, independent verification and consequences for noncompliance.

What companies should demand

Enterprise buyers should not treat a lab’s participation in a voluntary framework as proof that its systems are safe for high-stakes use. Procurement teams should keep asking for evidence relevant to their own deployments: security testing, documented model limitations, incident-reporting processes, access controls, change-management commitments and contractual accountability.

For founders building near frontier models or developer tooling, the policy risk is more direct. Monitor whether proposed rules are tied to capabilities and compute scale, or instead to vague labels that can expand over time. Also watch whether independent auditors are genuinely independent, what they can inspect, and whether audit findings can be disclosed to regulators or the public.

The China argument will shape the outcome

International competition remains the largest obstacle. US AI leaders often argue that slowing domestic development simply advantages China. China’s Foreign Ministry has already criticized the slowdown calls as fearmongering.

But geopolitical competition does not eliminate the need for controls. It raises the bar for making them durable. A US-only voluntary compact could push activity elsewhere, while a broad domestic mandate could become a de facto incumbent advantage. The better test is whether policymakers can focus oversight on demonstrable high-risk capabilities while preserving room for ordinary research and product competition.

What to watch next

The next signal is not another statement from CEOs. It is whether the proposal gains operational commitments: named auditors, defined access rights, shared reporting standards, compute or capability thresholds, published findings and real penalties for breach.

Without those elements, “pacing the frontier” may be useful language for a serious risk discussion. It will not be evidence that the frontier has actually slowed.

Sources

STAY AHEAD

The future of business, in your inbox.

Useful signals on the companies, technologies and shifts changing business.

One useful briefing. Unsubscribe any time.