Another shot at the "AI Question"
- Leon Como

- May 10
- 4 min read

Is AI escalation about to kill us or end human civilization?
My biased answer as a human is: big NO.
But that answer is not enough. A human-biased NO can become denial. A doom-biased YES can become paralysis. The better move is to run the question through a decision framework:
Knowledge–Intelligence–Wisdom bounded by Consequence Accounting. (UVT-KIW-TRG-001 v2)
Knowledge: What do we actually know? Current evidence does not support deterministic AI doom. But it does support non-trivial severe-risk concern. The 2026 International AI Safety Report groups general-purpose AI risks into malicious use, malfunctions, and systemic risks, while also noting uncertainty and gaps in risk evaluation. (International AI Safety Report)
Intelligence: Which factors are active? The risk is not “AI exists, therefore civilization ends.” The risk rises when several factors converge: rapid capability improvement, autonomous/agentic deployment, cyber/bio misuse pathways, weak evaluation, institutional dependence, and race dynamics. AI risk is socio-technical: it depends not only on the model, but on how it is used, who operates it, and the social context of deployment. (NIST Publications)
Wisdom: What must not change? No intelligence system should gain decision authority faster than humans can preserve consequence ownership.
Consequence Accounting: What can we responsibly allow to happen?
Here is the conditional posture:
Scenario | Civilizational risk posture | Decision stance |
AI progress continues, but deployment remains bounded and accountable | Low but non-zero | Proceed with controls |
Fast AI progress + weak audits + shallow governance | Serious | Slow, test, constrain |
Agentic autonomy + critical infrastructure access + poor reversibility | High | Do not scale without hard gates |
AI-enabled cyber/bio misuse + geopolitical race dynamics | Severe tail-risk zone | Treat as civilizational security issue |
Recursive AI acceleration + institutional dependence + no consequence ownership | Extreme risk zone | Stop, contain, redesign governance |
KIW + Consequence Accounting adopted as a real governance layer | Risk reduced, not eliminated | Proceed through bounded deployment |
Expert estimates are uncertain, but not negligible. One 2023 survey of 2,778 AI researchers found a median estimate of 5% that future AI advances could cause human extinction or similarly permanent severe disempowerment. That does not prove doom; it proves the tail risk is too serious to dismiss.
So my conclusion remains:
Big NO to inevitability. Big YES to serious conditional risk.
The antidote is not anti-AI fear. It is not blind AI acceleration either.
The antidote is this:
Do not let intelligence govern alone.
Knowledge must ground it. Wisdom must govern it. Consequence Accounting must bound it.
AI escalation is not automatically the end of human civilization. But if intelligence keeps scaling faster than consequence ownership, the risk becomes civilizational.
The right question is not:
“Will AI kill us?”
The better question is:
“Under what conditions does AI-amplified intelligence outrun human consequence accounting?”
That is where governance must focus.
Appendices
Historical arc that brought us here:
Phase | What changed | Over-indexing risk |
1. Measurement age | Reality became increasingly countable, sortable, and administrable. Hollerith’s punched-card tabulator was used for the 1890 U.S. Census and became an ancestor of IBM. (Census.gov) | “If it can be counted, it can govern.” |
2. Efficiency age | Taylor’s scientific management sought workplace efficiency through scientific analysis and systematized work. (Encyclopedia Britannica) | “If it can be optimized, it should be optimized.” |
3. Wartime intelligence age | World War II made intelligence advantage existential. Bletchley Park’s codebreaking work, including Enigma-related operations and codebreaking machinery, became a powerful symbol of information superiority shaping material outcomes. (Bletchley Park) | “If we know more than the enemy, we win.” |
4. Operations research age | WWII operations research gave executives and military leaders quantitative bases for operational decisions; after the war, these methods moved into business, government, logistics, and industry. (Encyclopedia Britannica) | “If the model improves outcomes, let the model steer.” |
5. Cold War systems age | Cybernetics, information theory, RAND-style systems analysis, game theory, nuclear strategy, and crisis stability made abstract intelligence central to survival-scale decisions. Wiener’s Cybernetics appeared in 1948, and Shannon’s information theory was also published in 1948. (Internet Archive) | “If the system can be modeled, it can be controlled.” |
6. Networked intelligence age | ARPANET began in 1969 and became a foundation of the internet, turning distributed information exchange into global infrastructure. (darpa.mil) | “If everything is connected, intelligence can scale everywhere.” |
7. AI/generative inference age | AI now makes inference, synthesis, simulation, translation, and generation cheap enough to be embedded into daily decisions. | “If intelligence can be generated on demand, it becomes tempting to treat it as authority.” |
Conditional probability matrix
Condition set | Extinction / permanent disempowerment risk | Civilization-scale disruption risk | Governance posture |
Bounded AI use: human accountability, low autonomy, good audits, reversible deployment | Low single digits | Low to moderate | Managed adoption |
Current race path: fast capability growth, uneven safety, mixed regulation | Mid-single digits to low teens | Moderate to high | Stronger gates needed |
Agentic scale-up: autonomous systems acting across tools, finance, cyber, infrastructure | Low teens or higher | High | Restrict and certify |
Misuse convergence: cyber, bio, persuasion, geopolitical race, weak monitoring | Material tail risk | Very high | Treat as security-critical |
Loss of consequence ownership: humans delegate authority faster than they can audit, reverse, or govern | Unbounded / unacceptable | Extreme | No-commit; redesign |
KIW + Consequence Accounting embedded: knowledge grounding, contextual intelligence, wisdom invariants, consequence ledger | Reduced but not zero | Reduced and more recoverable | Proceed with refresh triggers |
Transcending “AI”
“A” in AI | Meaning | Risk posture |
Artificial Intelligence | Machine-generated capability | Powerful but morally incomplete |
Augmented Intelligence | Human capability extended by machines | Better, but still dependent on human discipline |
Auditable Intelligence | Decisions can be inspected and traced | Stronger for governance |
Aligned Intelligence | System behavior is steered toward intended values | Necessary but often too abstract |
Accountable Intelligence | Consequences are owned, bounded, reviewed, and corrected | Most decision-complete |




Comments