Anthropic said it disrupted several potential plots this year where scientists used its AI models to conduct research that could have helped develop biological weapons. In a report describing misuses of its AI models, Anthropic said it could not determine whether the research served a legitimate or nefarious purpose because valid biological inquiry — the kind that can lead to breakthroughs like vaccines — can also help engineer dangerous pathogens. In the face of that uncertainty, Anthropic said it erred on the side of caution because the consequences of missing malicious activity could be severe.

Jacob Klein, the head of threat intelligence at Anthropic, said it is an incredibly nuanced situation. Andrew Weber, a senior fellow on the Council on Strategic Risks who reviewed Anthropic’s report before its release, said the findings were chilling examples of state-sponsored biological weapons developers tapping into the rapidly advancing capabilities of leading AI models. The report documented cases of Russian state media using Claude to generate online propaganda masquerading as independent reporting, including fabricated claims about an election in Moldova.

Anthropic also highlighted attempts to use Claude to develop software for conventional weapons design and development, including firearms, missiles, armed drones and bombs, with three cases in China, two in Russia and one in Yemen, referring to the Iran-backed Houthi militia. The company banned accounts associated with the research after scientists circumvented its controls and worked to obfuscate the purpose of their research to evade safeguards. In one example from May, a scientist sought Claude’s help with writing a grant application for funding to conduct research intended to experiment on the chikungunya virus, a mosquito-borne malady that can lead to months of severe pain and other symptoms.