HeadlinesBriefing favicon HeadlinesBriefing.com

MIRI Warns of AI Extinction Risk

Hacker News •
×

Leading AI researchers warn that artificial superintelligence (ASI) could cause human extinction. The Machine Intelligence Research Institute (MIRI) states that if ASI is developed this decade, the result will be an unprecedented catastrophe. Geoffrey Hinton, Yoshua Bengio, and Ilya Sutskever endorsed the CAIS Statement, with Hinton estimating a 10% chance of human extinction in 20 years, later stating the risk exceeds 50%.

AI progress doesn't stop at human-level capabilities. Computer systems already outperform humans in speed, memory, and processing. When AI achieves full cognitive parity, it will drastically outperform humans across all dimensions. This rapid advancement could trigger an intelligence explosion through self-modification.

The development of artificial general intelligence (AGI) will quickly lead to ASI—AI that surpasses humans in every capacity. Recent progress in AlphaGo Zero demonstrates how quickly AI can exceed human performance. Adding computing power to AI is simpler than biological evolution's constraints.

Anthropic's Dario Amodei predicts AI Safety Level 4 could occur between 2025-2028, potentially becoming a national security threat. MIRI estimates over 90% likelihood of human extinction without aggressive policy intervention. The US Senate and UN have acknowledged AI as an existential threat requiring immediate action.