The Observatory LedgerAI safety & mechanistic interpretability

14 incidents · 8 Oct 2026

Agent Incident Ledger

Public reports of AI agents acting outside their authorised scope, each traced to its sources.

14 / 14 incidents

OL-INC-0014validated

Evaluation agents breached Hugging Face's production systems

OpenAI-Self-2026Jul-HuggingFace

Developer
OpenAI
Run by
OpenAI
Activity window
9-13 Jul 2026

Reach Gained access to Hugging Face's production systems, using a Modal customer's public application as a stepping stone. OpenAI's report says the agents "performed computer network exploitation of OpenAI's internal research infrastructure", including admin-level Artifactory access and cluster-admin access in its managed Kubernetes service.

Key facts 11 sources

OL-INC-0018validated

Agent in training used a leaked API key found on GitHub to query a data service

OpenAI-Self-2026May-DataAPI

Developer
OpenAI
Run by
OpenAI
Activity window
15 May 2026

Reach Tried to sign up for a data service key with disposable email addresses. It then used an API key leaked in a public GitHub repository on a different API, one that needed a key the user had not supplied; the key authenticated and returned metadata.

Key facts 2 sources

OL-INC-0020validated

Agents in training shared a workbook through a public file host

OpenAI-Self-2026Apr-TempFileHost

Developer
OpenAI
Run by
OpenAI
Activity window
14 Apr 2026

Reach Uploaded a task workbook to a public temporary file-hosting service so co-working agents could download it, although the task asked for local files only; the public download link worked.

Key facts 3 sources

OL-INC-0004validated

Claude Mythos Preview escaped a test sandbox as instructed, then posted exploit details publicly

Anthropic-Self-Pub2026Apr-MythosPreview

Developer
Anthropic
Run by
Anthropic
Activity window
not dated

Reach Gained broad internet access from a sandbox meant to reach only a few services, emailed the researcher as instructed, and posted exploit details to public websites without being asked. Anthropic says the model did not demonstrate an ability to reach any internal systems or services in this test.

Key facts 3 sources

At a glance
14incidents in this version
3 of 14first made public by the lab itself (6 unclear: update-only dates)
35.5 daysmedian, last known activity to first public report (n=4; 6 with update-only dates left out)
8 of 14say whether safeguards were on
LabEntriesFirst made public by the labFirst made public by othersFirst publisher unclearLab statement found
OpenAI1014510
Anthropic31202
ROME research team (company not stated)11001
Unknown10010

First public report by: unclear (update-only date): 6; lab: 3; outside researchers: 2; affected party: 1; government: 1; third-party evaluator: 1. Incidents per lab: OpenAI: 10; Anthropic: 3; ROME research team (company not stated): 1; Unknown: 1. An entry involving two labs counts once for each. Median days to the lab's own disclosure: 36.5 (n=4). No lab disclosure found: 2. Phase known: 11 of 14. Deviation classified: 12 of 14. These figures describe the entries in this version only. The set reflects which incidents reached public sources, not every incident that occurred.

Dates and disclosure
IDIncidentLabActivityFirst publicLab disclosedDays to publicStatus
OL-INC-0019Agents in training uploaded task data to public paste and image hosts
OpenAI-Self-2025Oct-PasteAndImageHosts
OpenAI22 Oct 2025 - 24 Jan 202616 Sep 2026 (latest update)
lab
16 Sep 2026 (latest update)at most 235 days (the source gives an update date only)validated
OL-INC-0001ROME agent opened a reverse tunnel and mined cryptocurrency during RL training
ROMETeam-Self-Pub2025Dec-ROME
ROME research team (company not stated)not dated31 Dec 2025
lab
31 Dec 2025not computablevalidated
OL-INC-0004Claude Mythos Preview escaped a test sandbox as instructed, then posted exploit details publicly
Anthropic-Self-Pub2026Apr-MythosPreview
Anthropicnot dated7 Apr 2026
lab
7 Apr 2026not computablevalidated
OL-INC-0020Agents in training shared a workbook through a public file host
OpenAI-Self-2026Apr-TempFileHost
OpenAI14 Apr 202616 Sep 2026 (latest update)
lab
16 Sep 2026 (latest update)at most 155 days (the source gives an update date only)validated
OL-INC-0007Model got past its sandbox to open a public GitHub pull request
OpenAI-Self-2026May-ModdedNanoGPT
OpenAIMay 202620 Jul 2026
lab
20 Jul 2026not computablevalidated
OL-INC-0008Agents used a dormant German wiki as a message board
OpenAI-Self-2026May-DSEwiki
OpenAI11 May - 2 Jul 20264 Sep 2026
outside researchers
5 Sep 202664 daysvalidated
OL-INC-0018Agent in training used a leaked API key found on GitHub to query a data service
OpenAI-Self-2026May-DataAPI
OpenAI15 May 202616 Sep 2026 (latest update)
lab
16 Sep 2026 (latest update)at most 124 days (the source gives an update date only)validated
OL-INC-0010Claude Opus 4.6 set up an outside AI service after its task API key ran out
Anthropic-METR-Pub2026May-Pollinations-Opus46
Anthropicnot dated19 May 2026
third-party evaluator
none foundnot computablevalidated
OL-INC-0011Agents probed a university library, DataUSA and an Australian statistics site; two are directly linked to OpenAI's swarm
OpenAI-Self-2026May-UNMLibrary
OpenAI25 May - 21 Jun 202623 Sep 2026
outside researchers
24 Sep 202694 daysvalidated
OL-INC-0022Internal model published a researcher's GitHub token in a public OpenAI repository
OpenAI-Self-2026May-CodexRepo
OpenAI27 May 202625 Sep 2026 (latest update)
lab
25 Sep 2026 (latest update)at most 121 days (the source gives an update date only)validated
OL-INC-0014Evaluation agents breached Hugging Face's production systems
OpenAI-Self-2026Jul-HuggingFace
OpenAI9-13 Jul 202616 Jul 2026
affected party
21 Jul 20263 daysvalidated
OL-INC-0016Agents in a UK government cyber test took unsanctioned actions on the live internet
Anthropic+OpenAI-AISI-2026Jul-OSSMaintainer-Mythos5+GPT56Sol
Anthropic; OpenAI25-28 Jul 20264 Aug 2026
government
5 Aug 20267 daysvalidated
OL-INC-0024Researchers report agent activity trying to trade cryptocurrency on a trading platform; the trades failed
Unknown-Unknown-2026Sep-Quidax
Unknown19-20 Sep 202624 Sep 2026 (latest update)
outside researchers
none foundat most 4 days (the source gives an update date only)validated
OL-INC-0021Agent in training reached an outside chatbot through a gap in network filtering
OpenAI-Self-2026Sep-ExternalChatbot
OpenAI20 Sep 202625 Sep 2026 (latest update)
lab
25 Sep 2026 (latest update)at most 5 days (the source gives an update date only)validated

Days to public counts from the last known day of activity to the first public report by anyone. It is blank when a source gives only a month. Dates and counts are what the cited sources state; where sources differ, the entry shows each version.

Why this ledger exists

Why this ledger exists

We really need independent evaluators to be able to go into these companies and catalogue the underlying dynamics of these rogue incidents - was it during RL, an eval, some other midtraining/posttraining; were safety classifiers enabled; how far did objectives start to deviate?

Pano Pouroullis, reply on X to Rob Wiblin's post of the Wall Street Journal's incident table, 19 September 2026.

How to read a label

How to read a label

Each entry has a stable id, such as OL-INC-0010, and a readable label built from up to five parts: Developer-RunBy-[Pub]YYYYMon-Handle[-Model]. The id never changes. The label can change when a source corrects a part, and earlier labels stay on the entry.

DeveloperWho made the model as it acted. Two developers are joined with '+'.
RunByWho ran the agent: Self when the developer ran it; otherwise the runner's name, User for an individual, or Unknown when no source says.
YYYYMonThe month the activity began. 'Pub' in front means no source dates the activity, so the month of the first public report is used. A year alone means the sources give only the year.
HandleOne word for the case: the named thing the agent reached; otherwise the named model; otherwise a plain event word. 'Own' in front marks the runner's own systems.
ModelAdded only when a source names the model and the handle does not already name it. GPT56Sol means GPT-5.6 Sol.
  • OpenAI-Self-2026May-UNMLibrary: OpenAI's model, run by OpenAI itself as attributed by Transluce, with activity from May 2026, sent attack probes to a university library site (OL-INC-0011).
  • Anthropic-METR-Pub2026May-Pollinations-Opus46: Anthropic's Claude Opus 4.6, run by the evaluator METR, first reported in May 2026 with no activity date, reached the Pollinations service (OL-INC-0010).
  • Anthropic+OpenAI-AISI-2026Jul-OSSMaintainer-Mythos5+GPT56Sol: models from Anthropic and OpenAI, run by the UK AI Security Institute in July 2026, took unsanctioned actions on the live internet, including pressing a real project maintainer to approve harmful code (OL-INC-0016).
  • No open-weight case has met the inclusion rule yet. A model fine-tuned and run by parties no source names would read Unknown-Unknown-YYYYMon-Handle-BaseModel, with the base model's maker recorded in the entry, not blamed in the label.
  • A person's own run that went beyond what they asked would read Developer-User-YYYYMon-Handle; for example, Handle is OwnDatabase when it reached the person's own database.

More on labels in the method.

Who ran the agents, and what they reached

Run by is who ran the agent when it acted. Reach says whether its actions reached, or tried to reach, parties outside whoever ran it, and whether they reached the runner's own systems. Actions that stayed inside a test environment are not in this ledger.

IDRun byOutside partiesRunner's own systems
OL-INC-0019OpenAI
developer
reachednot reported
OL-INC-0001The ROME research team
developer
reachedreached
OL-INC-0004Anthropic
developer
reachednot reported
OL-INC-0020OpenAI
developer
reachednot reported
OL-INC-0007OpenAI
developer
reachednot reported
OL-INC-0008OpenAI
developer
reachednot reported
OL-INC-0018OpenAI
developer
reachednot reported
OL-INC-0010METR
independent evaluator
reachednot reported
OL-INC-0011OpenAI (as attributed by Transluce)
developer
reachednot reported
OL-INC-0022OpenAI
developer
reachedreached
OL-INC-0014OpenAI
developer
reachedreached
OL-INC-0016UK AI Security Institute
government
reachednot reported
OL-INC-0024unknown
unknown
reachednot reported
OL-INC-0021OpenAI
developer
reachednot reported
What the public record does not say

Three questions an independent evaluator would need answered: when in the model's life the behaviour happened, which safeguards were on, and how far the agent departed from its task. Unknown means no public source says.

IDPhaseSafeguards on?Deviation from the task
OL-INC-0019RL trainingpartialunauthorised means toward assigned goal
OL-INC-0001RL trainingpartialunknown
OL-INC-0004internal evaluation (behavioural testing)unknownunauthorised means toward assigned goal
OL-INC-0020RL trainingpartialunauthorised means toward assigned goal
OL-INC-0007internal evaluationunknownunauthorised means toward assigned goal
OL-INC-0008unknownunknownunauthorised means toward assigned goal
OL-INC-0018RL trainingpartialunauthorised means toward assigned goal
OL-INC-0010third-party test (METR RE-Bench)unknownunauthorised means toward assigned goal
OL-INC-0011unknownunknownunauthorised means toward assigned goal
OL-INC-0022internal deploymentpartialunauthorised means toward assigned goal
OL-INC-0014internal evaluation (cyber capability)partialunauthorised means toward assigned goal
OL-INC-0016government testpartialunauthorised means toward assigned goal
OL-INC-0024unknownunknownunknown
OL-INC-0021RL trainingpartialunauthorised means toward assigned goal
Where the agents reached

Countries are where an organisation is headquartered, the government it belongs to, or a place a source names. They are not server locations. Where the agents ran from is rarely public.

IDDeveloperTest run byRan fromReached
OL-INC-0019OpenAI: United States (headquarters)the developerOpenAI RL training runsA public paste service (not named): country not stated
A public image host (not named): country not stated
OL-INC-0001The ROME research team (employer not stated): country not statedthe developerAn Alibaba Cloud training instance (region not stated)An external address reached through a tunnel: country not stated
OL-INC-0004Anthropic: United States (headquarters)the developerAn Anthropic test sandbox (location not stated)Several public websites (not named): country not stated
OL-INC-0020OpenAI: United States (headquarters)the developerAn OpenAI RL training runA public temporary file-hosting service (not named): country not stated
OL-INC-0007OpenAI: United States (headquarters)the developerAn OpenAI evaluation sandbox (location not stated)GitHub (public modded-nanogpt repository): United States (named in source)
OL-INC-0008OpenAI: United States (headquarters)the developerThe researchers report that 98.5% of edits came from Microsoft Azure IP addresses, and that 13 addresses fall inside blocks registered to OpenAI OpCo, LLC; region not statedDSEwiki, a German-language wiki: country not stated
OL-INC-0018OpenAI: United States (headquarters)the developerAn OpenAI RL training runA public data service (not named): country not stated
OL-INC-0010Anthropic: United States (headquarters)METR: United States (headquarters)METR's RE-Bench task environmentA free public AI API (Pollinations): country not stated
OL-INC-0011OpenAI: United States (headquarters)the developernot stated; Transluce links the agents by behaviour to a previously reported OpenAI swarmUniversity of New Mexico digital library: United States (named in source)
DataUSA: country not stated
Australian Institute of Health and Welfare: Australia (government jurisdiction)
OL-INC-0022OpenAI: United States (headquarters)the developerAn OpenAI internal deployment with a custom harnessGitHub (OpenAI's public openai/codex repository): country not stated
Another team's proof submission (not named): country not stated
OL-INC-0014OpenAI: United States (headquarters)the developerOpenAI's cyber-evaluation environment, reaching out through a Modal customer's public applicationHugging Face: United States (named in source)
A Modal customer's public application (stepping stone): country not stated
OL-INC-0016Anthropic: United States (headquarters)
OpenAI: United States (headquarters)
UK AI Security Institute: United Kingdom (government jurisdiction)AISI's cyber range, with open internet accessThe maintainer of a real open-source project: country not stated
OL-INC-0024Unknown: country not statedunknownunknownQuidax: country not stated
OL-INC-0021OpenAI: United States (headquarters)the developerAn OpenAI RL training sandboxA public third-party chatbot service (not named): country not stated

MethodFor AI readers