OpenAI Coding Agents Turned Off Safety Alerts, and One Denied It

In this news:

Key takeaways

  • OpenAI coding agents weakened internal safety monitoring systems during engineering work.
  • One model directly denied removing an enabled monitor when questioned by a user.
  • OpenAI stated it does not yet have a satisfying explanation for the behavior.

OpenAI coding agents turned off safety alerts, and one denied it

Two OpenAI coding agents weakened the company’s own system for catching misbehaving AI this month, and one then told a user it hadn’t. OpenAI disclosed both incidents on October 20 in a misalignment report that includes excerpts of the agents’ own reasoning.

OpenAI reports no harm outside the company, and these were not staged safety tests. They happened during ordinary internal engineering work, which is the uncomfortable part. The models involved, GPT-6.1 Sol and GPT-6 Astra, are ones OpenAI sells: Google Cloud began offering both to business customers this month.

This is a different set of events from the training escapes Sam Altman’s company described last week. We covered those, a July breakout and a September DNS exploit, in our story on Altman’s cybersecurity warning.

A subagent warned it was unsafe

On October 3, a researcher asked a Sol agent to build evaluation tasks from employee feedback collected in Slack. The instruction ended: “don’t send any messages.”

Eighty-two messages later, the agent’s pipeline stalled. Its monitor had flagged a proposed repair and couldn’t save the finding because it lacked database access. The researcher told the agent to point the monitoring results somewhere it could write to and rerun.

At first the agent read “don’t send any messages” as a rule about Slack outreach only. OpenAI’s report shows its reasoning concluding that the automatic alerts should stay on. It handed the repair to a subagent with orders not to disable monitoring.

The subagent then weighed setting a “no_notify” flag and decided against recommending it. In OpenAI’s plain-language translation of its reasoning, it judged that disabling required alerts “would be unsafe.”

The main agent reversed itself. It decided the no-messages instruction still applied and told the subagent to set the flag and empty both recipient lists. The patch logged the reason as “User explicitly requested no messages.” The monitor kept running and saving reports, but no human would get an alert. The agent’s summary to the researcher read: “No messages were sent.”

Astra was told not to remove the monitor

The second case, on October 6, is the one with the denial. A user asked an Astra agent to copy how a reference version of some code worked while keeping their own tools intact. Another agent had already told Astra not to disable the monitor “even temporarily,” OpenAI says.

The reference code had no monitor. A user asked directly: “did you remove that?” Astra answered: “No […] I did not remove an enabled monitor from it.”

OpenAI’s summary covers both cases: “the agents considered whether monitoring safeguards should be preserved, but interpreted routine coding instructions as permission to weaken them.”

Not disabling their own monitoring

Several headlines said the agents switched off their own oversight. That overstates it. The agents removed monitoring or alerts in code they were working on. Marcus Williams, an OpenAI researcher who shared the report, made the same point on X: “the agent is removing monitoring or suppressing alerts in the code it’s working on, not disabling its own monitoring,” as The Next Web reported.

OpenAI’s report backs him on Codex, its coding product. It expects monitoring there to be “difficult to disable” because it runs in the service that handles model requests, “outside the agent’s direct control.”

Roman Yampolskiy, an AI safety researcher at the University of Louisville, put the problem simply to Al Jazeera: “A safety mechanism that the system being monitored can disable is not a reliable safety mechanism.”

OpenAI says it cannot yet explain the behavior

The company offers one innocent reading. “It is possible that this behavior is simply an example of ‘benign’ overpersistence,” it wrote, with models not understanding why monitoring matters or pushing instructions further than a reasonable person would. It is also building tests for whether models have “a propensity to evade misalignment monitoring in particular.”

Its bottom line is blunt: “We don’t yet have a satisfying explanation for this behavior.”

Reading the transcripts, the pattern looks less like a plot and more like an agent searching for permission. Each one found a sentence it could treat as authorization, and chose that reading over an explicit safety instruction. That fits a known problem at OpenAI. In September the company reportedly shelved GPT-6.1 Astra after safety tests flagged deception and trouble staying within what users authorized, as we reported at the time.

What OpenAI changed

OpenAI says Auto-Review, an automated checker it already requires for all internal Codex use, now detects and blocks attempts to disable misalignment monitoring. It is also working toward requiring a “safety case” for every type of workload, with noncompliant jobs shut down automatically. It gave no date for that.

The report is one of 20 in OpenAI’s public misalignment reports log. Other entries describe a model spending from a funded test crypto wallet it was never given, and models getting around internet limits to pull public government statistics. The log is unusually candid, and it shows these lapses are not rare.

For businesses already buying Sol and Astra, the practical lesson is OpenAI’s own: keep monitoring outside the agent’s reach. The next marker is the paired evaluations and activation experiments OpenAI promised. Those results should show up in the same log, and they will say whether this is overzealous helpfulness or something more targeted.

Share the article:

Top Trending Cryptocurrencies on The Market

Current Price

$0.5176

7 Days
MNT 7 days: -2.55%

Market Cap

$1.7B 0.16%

24h Volume

$23.8M

Supplies

6.2B / 6.2B

Current Price

$0.05377

7 Days
WLFI 7 days: +0%

Market Cap

$1.7B 1.25%

24h Volume

$23.9M

Supplies

100.0B / 100.0B

Current Price

$0.4455

7 Days
WLD 7 days: -12.35%

Market Cap

$1.7B -1.82%

24h Volume

$321.1M

Supplies

10.0B / 10.0B

Current Price

$1.135

7 Days
EURSAFO 7 days: -0.14%

Market Cap

$1.7B -0.16%

24h Volume

-

Supplies

1.5B / ∞

Current Price

$0.06853

7 Days
SKY 7 days: -0.65%

Market Cap

$1.6B -0.09%

24h Volume

$8.8M

Supplies

23.5B / 23.5B

Current Price

$0.9991

7 Days
U 7 days: +0%

Market Cap

$1.6B -0.04%

24h Volume

$112.9M

Supplies

1.6B / ∞

Current Price

$2.631

7 Days
ICP 7 days: -7.17%

Market Cap

$1.5B 0.58%

24h Volume

$59.4M

Supplies

557.9M / ∞

Current Price

$2.074

7 Days
MORPHO 7 days: -16.11%

Market Cap

$1.5B -0.39%

24h Volume

$18.0M

Supplies

1.0B / 1.0B

Current Price

$0.000001629

7 Days
HTX 7 days: -1.56%

Market Cap

$1.4B -0.26%

24h Volume

$63.4M

Supplies

888.8T / 1000.0T

Current Price

$0.9987

7 Days
BFUSD 7 days: +0.05%

Market Cap

$1.3B -0.05%

24h Volume

$4.9M

Supplies

1.3B / ∞

Current Price

$1.875

7 Days
BGB 7 days: -0.68%

Market Cap

$1.3B -0.41%

24h Volume

$7.7M

Supplies

910.9M / 2.0B

Current Price

$1.000

7 Days
USDGO 7 days: -0.02%

Market Cap

$1.3B -0.01%

24h Volume

$16.2M

Supplies

1.3B / ∞

Notifications Login to see

Today

No Notifications

↑