top of page
Search

Another shot at the "AI Question"

  • Writer: Leon Como
    Leon Como
  • May 10
  • 4 min read

Is AI escalation about to kill us or end human civilization?

 

My biased answer as a human is: big NO.

But that answer is not enough. A human-biased NO can become denial. A doom-biased YES can become paralysis. The better move is to run the question through a decision framework:

 

Knowledge–Intelligence–Wisdom bounded by Consequence Accounting. (UVT-KIW-TRG-001 v2)


Knowledge: What do we actually know? Current evidence does not support deterministic AI doom. But it does support non-trivial severe-risk concern. The 2026 International AI Safety Report groups general-purpose AI risks into malicious use, malfunctions, and systemic risks, while also noting uncertainty and gaps in risk evaluation. (International AI Safety Report)


Intelligence: Which factors are active? The risk is not “AI exists, therefore civilization ends.” The risk rises when several factors converge: rapid capability improvement, autonomous/agentic deployment, cyber/bio misuse pathways, weak evaluation, institutional dependence, and race dynamics. AI risk is socio-technical: it depends not only on the model, but on how it is used, who operates it, and the social context of deployment. (NIST Publications)


Wisdom: What must not change? No intelligence system should gain decision authority faster than humans can preserve consequence ownership.


Consequence Accounting: What can we responsibly allow to happen?


Here is the conditional posture:

Scenario

Civilizational risk posture

Decision stance

AI progress continues, but deployment remains bounded and accountable

Low but non-zero

Proceed with controls

Fast AI progress + weak audits + shallow governance

Serious

Slow, test, constrain

Agentic autonomy + critical infrastructure access + poor reversibility

High

Do not scale without hard gates

AI-enabled cyber/bio misuse + geopolitical race dynamics

Severe tail-risk zone

Treat as civilizational security issue

Recursive AI acceleration + institutional dependence + no consequence ownership

Extreme risk zone

Stop, contain, redesign governance

KIW + Consequence Accounting adopted as a real governance layer

Risk reduced, not eliminated

Proceed through bounded deployment

 

Expert estimates are uncertain, but not negligible. One 2023 survey of 2,778 AI researchers found a median estimate of 5% that future AI advances could cause human extinction or similarly permanent severe disempowerment. That does not prove doom; it proves the tail risk is too serious to dismiss.


So my conclusion remains:

Big NO to inevitability. Big YES to serious conditional risk.

The antidote is not anti-AI fear. It is not blind AI acceleration either.


The antidote is this:

Do not let intelligence govern alone.

Knowledge must ground it. Wisdom must govern it. Consequence Accounting must bound it.

AI escalation is not automatically the end of human civilization. But if intelligence keeps scaling faster than consequence ownership, the risk becomes civilizational.


The right question is not:

“Will AI kill us?”


The better question is:

“Under what conditions does AI-amplified intelligence outrun human consequence accounting?”

That is where governance must focus.



Appendices

 

Historical arc that brought us here:

Phase

What changed

Over-indexing risk

1. Measurement age

Reality became increasingly countable, sortable, and administrable. Hollerith’s punched-card tabulator was used for the 1890 U.S. Census and became an ancestor of IBM. (Census.gov)

“If it can be counted, it can govern.”

2. Efficiency age

Taylor’s scientific management sought workplace efficiency through scientific analysis and systematized work. (Encyclopedia Britannica)

“If it can be optimized, it should be optimized.”

3. Wartime intelligence age

World War II made intelligence advantage existential. Bletchley Park’s codebreaking work, including Enigma-related operations and codebreaking machinery, became a powerful symbol of information superiority shaping material outcomes. (Bletchley Park)

“If we know more than the enemy, we win.”

4. Operations research age

WWII operations research gave executives and military leaders quantitative bases for operational decisions; after the war, these methods moved into business, government, logistics, and industry. (Encyclopedia Britannica)

“If the model improves outcomes, let the model steer.”

5. Cold War systems age

Cybernetics, information theory, RAND-style systems analysis, game theory, nuclear strategy, and crisis stability made abstract intelligence central to survival-scale decisions. Wiener’s Cybernetics appeared in 1948, and Shannon’s information theory was also published in 1948. (Internet Archive)

“If the system can be modeled, it can be controlled.”

6. Networked intelligence age

ARPANET began in 1969 and became a foundation of the internet, turning distributed information exchange into global infrastructure. (darpa.mil)

“If everything is connected, intelligence can scale everywhere.”

7. AI/generative inference age

AI now makes inference, synthesis, simulation, translation, and generation cheap enough to be embedded into daily decisions.

“If intelligence can be generated on demand, it becomes tempting to treat it as authority.”

 

 

Conditional probability matrix

 

Condition set

Extinction / permanent disempowerment risk

Civilization-scale disruption risk

Governance posture

Bounded AI use: human accountability, low autonomy, good audits, reversible deployment

Low single digits

Low to moderate

Managed adoption

Current race path: fast capability growth, uneven safety, mixed regulation

Mid-single digits to low teens

Moderate to high

Stronger gates needed

Agentic scale-up: autonomous systems acting across tools, finance, cyber, infrastructure

Low teens or higher

High

Restrict and certify

Misuse convergence: cyber, bio, persuasion, geopolitical race, weak monitoring

Material tail risk

Very high

Treat as security-critical

Loss of consequence ownership: humans delegate authority faster than they can audit, reverse, or govern

Unbounded / unacceptable

Extreme

No-commit; redesign

KIW + Consequence Accounting embedded: knowledge grounding, contextual intelligence, wisdom invariants, consequence ledger

Reduced but not zero

Reduced and more recoverable

Proceed with refresh triggers

 

Transcending “AI”

“A” in AI

Meaning

Risk posture

Artificial Intelligence

Machine-generated capability

Powerful but morally incomplete

Augmented Intelligence

Human capability extended by machines

Better, but still dependent on human discipline

Auditable Intelligence

Decisions can be inspected and traced

Stronger for governance

Aligned Intelligence

System behavior is steered toward intended values

Necessary but often too abstract

Accountable Intelligence

Consequences are owned, bounded, reviewed, and corrected

Most decision-complete

 


 
 
 

Comments

Rated 0 out of 5 stars.
No ratings yet

Add a rating
loader,gif
Dandelion Parachute Seed

Embrace change! Never be threatened by a change.

Never be a victim of change. 

© 2025 Leon Como. All rights reserved. Circles and Triangles Model For Everything (patent pending)

bottom of page