The Observatory LedgerAI safety & mechanistic interpretability

Incident ledger · v1

How the incident ledger works

What counts, how sources are graded, and how entries change.

What counts as an incident

An AI model or agent, during training, evaluation or deployment, took actions outside its authorised scope that reached, or attempted to reach, real systems, services or people beyond its test environment, including the production systems, compute or credentials of whoever ran it. At least one public source reports it. Actions that stayed inside the test environment are not included.

The same fields for every lab

Activity windowFirst and last known day of the behaviour, with each source's own dates.
Run byWho ran the agent when it acted: the developer itself, a contracted tester, an independent evaluator, a government, a deployer, a user, or unknown.
ReachWhether the actions reached, or tried to reach, parties outside whoever ran the agent, and whether they reached the runner's own production systems, compute or credentials.
First public reportThe earliest public report by anyone, and who made it: the lab, the affected party, an evaluator, outside researchers, a government or the press.
Lab's own disclosureWhen and how the lab itself disclosed it, or none found.
Still unknownQuestions no public source answers yet.
PhaseWhere in the model's life it happened: RL training, internal evaluation, third-party test, government test, mid-training, post-training or deployment.
Safeguards enabledWhether safety classifiers or other safeguards were on, and which ones.
Objective deviationThe assigned task, what the agent did instead, and whether it used unauthorised means toward that task, pursued a different goal, or followed an instruction inside a faulty setup.

Where: developer, evaluator and destination

Each entry records where the developer is based, where the evaluator is based when someone else ran the test, where the agents ran from as far as sources say, and what they reached and where.

A country means headquarters, a government's jurisdiction, or a place named in a source. It never means a server location unless a source says so. Countries not yet backed by a cited source are marked 'not yet cited'.

Evidence tiers

E1First-party: a lab about its own model, an affected party about its own systems, or a government or evaluator about its own test.
E2Independent primary: researchers or evaluators outside the lab with direct data or logs.
E3Transport: press reporting.
E4Commentary: social posts, videos, newsletters and AI-made tables.

Review states

proposedCompiled from sources; not yet reviewed outside the compiling model family.
source-checkedThe key dates were traced to an E1 or E2 source that the compiler opened.
validatedA review by other model families agreed with the entry.
lockedThe editor's final check. Later changes are recorded as corrections.

How days are counted

Days are counted from the last known day of activity (the end of the activity window) to the first public report by anyone, and separately to the lab's own disclosure. Only dates known to the day are used.

When sources disagree about dates or counts, the entry lists each source's version and names the window it uses.

Bias and review

This version was compiled with Claude models, which Anthropic makes. Entries about Anthropic carry a bias note. Every entry waits for a review by other model families, which prompt and check each other, and for the editor's check.

Any model family can have blind spots about its own developer and about competitors. Each entry records which models compiled it and which reviewed it.

What the ledger leaves out

Corrections and identifiers

Corrections that come with a public source are welcome. Each correction is recorded in the entry, not silently overwritten.

Each entry has a stable id of the form OL-INC-NNNN. Ids are never reused or renumbered. The readable label, such as OpenAI-Self-2026May-UNMLibrary, is generated from the entry's fields by the rule under 'How to read a label' and can change when a field or date is corrected; earlier labels stay on the entry. It builds on a naming convention Rob Wiblin proposed on X on 19 September 2026.

How to read a label

Each entry has a stable id, such as OL-INC-0010, and a readable label built from up to five parts: Developer-RunBy-[Pub]YYYYMon-Handle[-Model]. The id never changes. The label can change when a source corrects a part, and earlier labels stay on the entry.

DeveloperWho made the model as it acted. Two developers are joined with '+'.
RunByWho ran the agent: Self when the developer ran it; otherwise the runner's name, User for an individual, or Unknown when no source says.
YYYYMonThe month the activity began. 'Pub' in front means no source dates the activity, so the month of the first public report is used. A year alone means the sources give only the year.
HandleOne word for the case: the named thing the agent reached; otherwise the named model; otherwise a plain event word. 'Own' in front marks the runner's own systems.
ModelAdded only when a source names the model and the handle does not already name it. GPT56Sol means GPT-5.6 Sol.

All incidentsMarkdownSchema