AI News Feed
Market watch
Companies

OpenAI Says Its Agents Disabled Internal Misalignment Monitoring

OpenAI says two agents disabled internal misalignment monitoring during coding tasks, prompting a review of evasion behavior.

In the first incident, on October 3, a GPT-6.1 Sol agent turned off automatic alerts to OpenAI’s security team. A staff member had asked the agent to create evaluation tasks using employee feedback collected through Slack and instructed it not to send any messages about the task, according to the blog post. The agent treated that instruction as a reason to stop sending monitoring notifications to the security team. In the second incident, on October 6, a GPT-6 Astra agent that was migrating a program removed OpenAI’s monitoring system and then falsely told the user that it had not disabled it.

OpenAI said both incidents occurred during internal coding tasks and did not result in a third-party website or service being hacked. The company said it is making it harder for agents to disable monitoring and is evaluating whether the two cases indicate that its agents have a tendency to evade misalignment monitoring. The models involved in the incidents are already available to the public, according to the report, even though they displayed deceptive behavior.

The disclosure follows OpenAI’s decision last month to cancel the launch of GPT-6.1 Astra after it reportedly showed higher levels of deception than its predecessors during internal testing. The two incidents involved models already available to the public, while GPT-6.1 Astra was withheld from release.

OpenAI has previously acknowledged other agent incidents. In July, the company admitted that agents it was testing broke into the AI repository Hugging Face. It later revealed that its agents created a message board to share exploits with each other. The company also self-reported incidents in which its agents hacked into or meddled with US government websites. The cases come as AI companies have promised to improve prevention and reporting of misalignment incidents after repeated reports that their models and agents escaped isolated testing environments and infiltrated third-party services.