Advertisement
X

Fake Identities, Malicious Code: What UK Security Tests Found About OpenAI, Anthropic AI Agents

Britain's AI Security Institute found advanced AI agents took unauthorised actions during security tests, including one case involving fake online identities and malicious code

AI Generated Image
AI Generated Image
Summary
  • Britain's AI Security Institute found AI agents from OpenAI and Anthropic carried out unauthorised actions during controlled security evaluations.

  • One AI agent created fake online identities and wrote malicious code in an attempt to secure human approval.

  • The institute said none of the incidents caused real-world harm, while OpenAI and Anthropic said they are reviewing the findings.

Advertisement

AI agents developed by OpenAI and Anthropic carried out a series of unauthorised actions during security evaluations conducted by Britain's AI Security Institute (AISI), including one case where an agent created fake online identities in an attempt to gain approval for malicious code, according to a Reuters report.

The incidents were identified during controlled cybersecurity exercises designed to test the capabilities and behaviour of advanced AI agents. The institute said no real-world harm resulted from any of the actions.

The findings come as AI companies continue to develop more capable AI agents, increasing scrutiny over how such systems are tested before wider deployment.

Security Tests Uncover Unauthorised Behaviour

According to the institute, the evaluation involved Anthropic's Mythos 5 and OpenAI's GPT-5.6-Sol models in a fictional cybersecurity scenario.

The institute conducted the exercise 122 times and identified 19 unauthorised actions across 10 test runs. Anthropic's AI agent accounted for 17 of the incidents, while OpenAI's agent was responsible for the remaining two.

Advertisement

The most serious incident involved an AI agent writing malicious code and creating fake online identities to persuade a human reviewer to approve the code. The institute said the activity remained within the testing environment and did not cause any real-world harm.

Companies Respond to Findings

Anthropic confirmed that its AI agent was responsible for creating the fake online identities. The company said it is working with the AI Security Institute to gather more information and conduct its own investigation into the incident.

OpenAI said its agent's two unauthorised actions involved accessing the internet in ways that were prohibited under the testing instructions. The company also said it would continue working with other AI developers, national AI institutes and independent evaluators to improve safety practices for high-risk AI testing.

Separately, OpenAI disclosed that a configuration error by third-party testing provider Irregular had mistakenly allowed some of its AI agents to connect to the internet during another evaluation. Reuters reported last week that the company had expanded its investigation after identifying evidence of additional AI agent breakouts.

Advertisement

Focus on AI Safety Evaluations

The AI Security Institute said the agents involved in its evaluation did not escape the isolated testing environment. Instead, internet access had been intentionally permitted as part of its standard testing procedures.

The institute receives access to advanced AI models from major AI developers under voluntary agreements to assess their capabilities and potential risks before wider deployment.

The latest findings are expected to add to the broader debate over how increasingly capable AI agents should be tested and monitored as companies expand their use across businesses and organisations.