Some dangerous biology looks much like legitimate research, complicating AI safeguards.

A maelstrom over AI safety kicked off earlier this week when Jacob Coxon resigned from the company, saying employees "earnestly believe it [AI] could kill us all by the end of the decade." Concerns escalated earlier this year with the release of advanced models such as Anthropic's Mythos. Open AI also caused alarm in July when it said its models had autonomously hacked into AI group Hugging Face.

There is an expanding consensus among AI executives and biosecurity researchers that the use of the technology in biology needs to be secured and regulated as models become more advanced. Experts increasingly worry that AI could be used by terrorist groups, state actors, or lone-wolf attackers to craft biological weapons, create viruses, or unleash existing harmful pathogens. But even if AI can be used to design a theoretical bioweapon, potential obstacles remain, such as the ability to make it in practice and the resources needed to do so.

Cybersecurity has been among the biggest concerns for safety advocates. Anthropic's report on the misuses of its technology detailed incidents including "a network of fake dating apps designed to defraud users to surveillance systems built to identify and monitor dissidents." The lab also set out new details of claims that seven labs based in China, including Moonshot and Deep Seek, tried to replicate its technology through a process known as distillation. Anthropic said it had detected "increasingly sophisticated methods to circumvent our defenses and harvest the capabilities of US frontier models."