Risk & safety · Research field
Existential risk from AI
Catalogued:
What it means
The study and debate of scenarios in which AI contributes to human extinction or a permanent, severe loss of humanity’s future potential. It is not a claim that today’s chatbot is secretly conscious. Proposed mechanisms, probabilities and appropriate responses are contested.
The strongest case
Even an uncertain low-probability outcome may merit attention when the potential loss is very large. Investigating mechanisms before they are fully realized can be more useful than waiting for a conclusive disaster.
The difficult part
Large stakes do not establish a specific probability or policy. Theories need concrete causal pathways and scrutiny. Attention to distant catastrophe should not erase present harms, and disagreement should not be reduced to whether someone cares about humanity.
Sources & further reading
Sources support the factual context. The jokes are our responsibility.