Governance & Safety

Rogue-AI risk needs a progression map

Do not wait for catastrophe as the first clear event. This paper argues for a shared map of warning signs. That does not solve governance. It gives researchers and policymakers a ruler for deciding when evidence should trigger action before a crisis.

AI Agency
Read original source

What the source reports

Bauer and coauthors propose a map of warning signs for progress toward catastrophic AI threats. The approach borrows from cyber defense and national security. In those fields, teams name warning signs before an incident. The abstract says the framework sets metrics, indicators, and thresholds. These span several parts of AI capability and behavior. The goal is evidence-based monitoring protocols for researchers and policymakers. This is a governance and measurement proposal. It does not claim a rogue AI event has occurred. The abstract also gives no deployment results. Its value is turning a vague fear into staged questions that can be watched by teams before a crisis.

Original source

Title
Reducing Catastrophic Risk from AI with Systematic Monitoring and Evaluation of Rogue AI Progression
Author
Bauer, Kegelmeyer, Begoli, Sadovnik, Emerson, Corley, Generous, Moore, Bartoldson, Goldhan, Goldman, Greaves, Vermeer, MacLennan, Schulker
Publication
arXiv