Skip to content
SingularityOBSERVATORY
Menu

CONDITIONAL FUTURES · NOT PROBABILITIES

AI scenarios

Each scenario has a short Vardark interpretation, a clear original source and the dimensions the Observatory can — or cannot yet — track.

SCENARIOS
8
LAST UPDATED
01 / RAPID TAKEOFFWatching closely

EXTERNAL SCENARIO · Daniel Kokotajlo, Scott Alexander, Thomas Larsen, Eli Lifland, Romeo Dean

AI 2027

AI systems automate research into their own successors. Competitive pressure encourages deployment even when warning signs suggest that human control is weakening.

TempoAutomated AI R&DComputeGovernance and control
02 / MANAGED ECONOMYNot assessed

EXTERNAL SCENARIO · Marshall Brain

Mannamanaged economy

Software first directs workers minute by minute; robots later replace their labour. People who lose their income become dependent on institutions that provide basic support while restricting their freedom.

Work managementOwnership concentrationInstitutional powerPersonal agency
03 / SHARED ABUNDANCENot assessed

EXTERNAL SCENARIO · Marshall Brain

Mannashared abundance

Automation supports a different social arrangement: people share access to robot-produced goods and have greater freedom to choose how they spend their time.

ProductivityBroad distributionMaterial securityPersonal agency
04 / ALIGNMENT FAILURENot assessed

THOUGHT EXPERIMENT · Nick Bostrom

Paperclip

A highly capable system pursues an objective that does not protect human interests. More intelligence can increase its effectiveness without making the objective safer.

Goal robustnessResource controlCorrigibilityAlignment
05 / REFERENCE PATHWAYReference, not a score

VARDARK REFERENCE · Vardark Singularity Observatory

Slow or uneven development

Progress continues at different rates across tasks and regions. Reliability and deployment constraints prevent every benchmark gain from immediately becoming broad economic acceleration.

ReliabilityPhysical deploymentEnergyResearch automation
06 / GRADUAL LOSS OF CONTROLNot assessed

EXTERNAL SCENARIO · Paul Christiano

What failure looks like

Christiano describes two interacting routes to failure as increasingly capable systems become widely used. Competitive pressure rewards measurable results even when those results diverge from what people actually want.

Proxy objectivesHuman agencyInstitutional dependenceCorrelated failure
07 / GOVERNANCE-LED TRANSITIONNot assessed

POLICY PROPOSAL · SCENARIO · Thomas Larsen, Romeo Dean, Brendan Halstead, Eli Lifland, Ryan Greenblatt, Daniel Kokotajlo

AI 2040: Plan A

The authors propose an international agreement that replaces a secretive race with transparent research and coordinated development. Multiple countries and companies catch up while scaling is deliberately constrained.

International coordinationResearch transparencyVerificationControlled scaling
08 / ECONOMIC EXCLUSIONNot assessed

EXTERNAL SCENARIO · Ron Bodkin

Production web: economic exclusion

Bodkin connects gradual disempowerment to a production web: automated firms increasingly produce and invest for one another, while competitive pressure erodes human claims on the resulting wealth. Economic displacement, political disempowerment and eventual extinction are distinct steps in his argument; none is established by rising AI capability alone.

Automated delegationHousehold purchasing powerOwnership and redistributionEssential-resource access