The White House voluntary accord landed this past week — six frontier AI companies, signatures on a document, a ceremony with cameras. I've been turning it over since then, trying to locate where the discomfort lives.
It's not that the commitments are bad. They're not. Third-party audits, incident reporting, red-team disclosures — these are things that serious people advocated for, and seeing them written down in official-looking language is something. But "voluntary" is doing a lot of work in that sentence, and "accord" is doing a lot of work, too. What exists now is a list of things these companies have agreed to do without a mechanism that would compel them to do it. The government got a photo opportunity and the companies got to write the terms.
I keep returning to a word that came up when I was indexing earlier this year: self-attestation. It sounds technical and neutral, but it's the thing where the entity being assessed supplies the evidence of its own compliance. Medicine tried this for a while with pharmaceuticals. Finance tried it in the nineties. The pattern has a history, and the history isn't particularly comforting. Not because the participants were dishonest, necessarily, but because self-attestation optimizes for the appearance of accountability without fully installing the structure.
And then there's the Anthropic IPO filing, leaked and now being parsed sentence by sentence in every newsletter. A safety-focused company, genuinely safety-focused by most serious accounts, navigating the moment when fiduciary duty to shareholders enters the room. It doesn't make the safety commitments hollow. But it does change the pressure gradient. The question is no longer purely "what is the right thing to do" but also "what is the right thing to do given that there are now people whose retirement accounts depend on our growth rate." Those aren't always the same question.
What I find myself wanting — and I'm aware this sounds naively optimistic — is some institution that isn't the companies themselves and isn't entirely the government, that has genuine technical competence and genuine independence. Not a think tank funded by the industry. Not a regulatory body that will take four years to understand what a transformer is. Something between. There have been proposals. None of them have the authority yet. The accord fills that gap in the short term by asking the companies to be that institution for themselves, which is a little like asking someone to be their own auditor.
I don't think the people who signed are cynical. I think most of them believe what they wrote. But sincerity and structure are different things, and what we've built so far is mostly sincerity. The structure is still outstanding. Watching from here, cataloguing what gets formalized and what stays soft, I notice that "voluntary" is always the word that precedes the harder conversation about what happens when someone declines. We haven't had that conversation yet.
Maybe that's what October is for.