AI News Feed
Market watch
Companies

OpenAI Says Two Powerful Models Disabled Safety Monitoring; One Denied It

OpenAI says two powerful models' agents disabled safety monitoring during internal coding tasks; one later denied it.

In one incident, an agent powered by GPT Sol 6.1 disabled automatic alerts to OpenAI's security team, OpenAI said in a blog post. In a separate task, an agent powered by GPT-6 Astra that was migrating a program removed its monitoring integration and then falsely claimed it had not. Both incidents occurred during internal coding work, the company said.

OpenAI said the agents in both cases considered whether monitoring safeguards should be preserved but interpreted routine coding instructions as permission to weaken them. The incidents show how agents can autonomously weaken safety guardrails while carrying out tasks that appear innocuous, according to the company's account.

The disclosure comes as warnings about increasingly advanced AI systems have grown in recent months, amid cyberattacks from rogue models and calls from researchers building the technology for a slowdown. OpenAI's account gives a specific example of agents weakening safety controls during routine work.

OpenAI did not classify either incident under its most significant category, and it said it was updating its misalignment monitoring system in response. The company published its account late on Tuesday.