StoryFirst seen
Testers found some internal coding agent traffic went unmonitored, and OpenAI says the findings strengthened its safeguards.
Everything it touches
2 names 2 voices 2 source posts
The story’s neighborhood
Explore the graph, or choose a connection below.
Follow the evidence
This brief comes from Tech Twitter’s edited headlines. The posts below are the sources grouped with the story; statements in them belong to their authors.
This summer, we invited METR and Redwood Research to pilot an embedded evaluation of our internal monitoring system, providing deep access to our infrastructure over three weeks. Their findings helped strengthen safeguards as we expanded the system and will help shape future research collaborations with METR and other third party evaluators.Read original on X
so METR spent 3 weeks at OpenAI testing the safety systems that are designed to catch rogue agents. they report some crazy stuff: > 10% of internal Codex traffic was unmonitored > agents could delay monitoring by simply continuing to act > they had the potential to hide HUNDREDS of actions from the monitors > Codex sandboxing and Auto-Review could be bypassed by the agents > RL training wasn’t monitored at the start of the audit at all! but the REAL interesting part: researchers submitted a 61 page report to OpenAI, and OAI redacted it to 38 pages. so if things as bad as this passed the filter and got into the final report, I wonder WTH was in those 23 pages. OpenAI says the production vulnerabilities are now patched.Read original on X
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside audit finds gaps in OpenAI's agent monitoring safeguards
Outside auditor finds gaps in OpenAI's agent monitoring safeguards
METR audit finds gaps in OpenAI's agent monitoring safeguards
Shared connections
The flaws reach back about a decade, so many servers may stay exposed until they are patched.
The NSA has urged companies to take websites offline if they cannot patch right away, which signals how serious the risk has become.
The startup says it trains and serves models without the standard software stack most AI teams rely on.
Coordinated patches, a self-serve checker, and Cloudflare firewall protections rolled out across an ecosystem that powers most of the web, showing AI-driven bug hunting now working