San FranciscoSix outside auditors now sit inside Anthropic’s office.
Anthropic cannot veto their publications but can redact customer data, privileged material and model architecture.
Anthropic says nonprofit METR gets hardware and tools roughly on par with its own risk teams, like bank examiners.
Critics cite accounting’s conflicts of interest and say government regulation is still required.
OpenAI has yet to lay out plans for outside evaluators, though Sam Altman called the idea good.
How each outlet framed it
- Ars Technica
- reports METR's embedded team with access to Anthropic's hardware and internal systems, the first step on Amodei's proposal for outside auditors
Sources: Ars Technica