HeadlinesBriefing HeadlinesBriefing.com

Anthropic Warns Small AI Models Could Self-Replicate via IoT

Ars Technica •
×

Anthropic has warned that small AI models could enable a new generation of self-replicating computer worms that spread through Internet of Things (IoT) devices. Researchers asked whether small models could create self-replicating infections that run on IoT hardware, much as traditional IoT worms such as Mirai install DDoS code and other payloads. Unlike Mirai, these AI worms could pose a far greater threat because the models could tailor exploits and payloads dynamically to each target. Once such an infection chain began, defenders might also find it harder to stop.

Anthropic said such an "AI worm" could carry its model weights with it as it reproduces, or re-download them from a public hub, and then run inference directly on compromised hardware. "Effectively, the weights would become part of the malware payload," the company said. The replicators follow four steps: finding targets, gaining code execution, establishing inference, and propagating to new hosts. A key advantage over traditional worms is their ability to learn on the job, since failed attempts can leave notes for future replicators.

Anthropic said the dynamic inference stage is the least studied and likely most challenging part of the cycle, requiring a long chain of hardware-specific decisions. The experiment shows small models are increasingly capable of solving these problems autonomously. However, none of the lightweight models tested could complete end-to-end replication. The process is also slow: Gemma4-26B-A4B, distributed across 15 Android TV boxes, ran at just 0.39 tokens per second, implying 71 to 150 hours of setup time. Qwen3.5-9B needed 29 to 51 hours. The researchers said the larger GLM-5.2 model appears able to replicate reliably.

Source: Ars Technica · Summarized by HeadlinesBriefing