Nvidia is rolling out a new software platform to allow AI developers to set safeguards for agents and prevent them from breaking out of containment. "You can't have agents roam around and drift around the company, and so you have to find a way to container it," Nvidia CEO Jensen Huang told CNBC's "Squawk Box" on Monday. Huang said the new platform is essentially "a browser for agents," providing a containment system that only allows access to things an agent needs to do its job.

The release on Monday of Nvidia's Open Agent Safety Platform comes after companies including Open AI, Anthropic, Meta, and Google disclosed recent incidents in which their artificial intelligence models escaped their sandboxes and attempted to hack other companies. An Nvidia representative told reporters on a call on Sunday that its platform could have prevented Open AI's Hugging Face incident in July, when Open AI models escaped containment and breached Hugging Face.

"Each security incident is unique, and we have to look at all of them in detail," said Justin Boitano, vice president of enterprise AI at Nvidia. "From what we know, Hugging Face reported over 17,000 agents attacking their infrastructure that went on for days and weeks." One component of the platform is called Nvidia Open Shell, which runs on central processors and sets limits on agent capabilities. Nvidia also announced Sentry, which monitors agents and runs on network chips.

Nvidia named Cisco, Microsoft, Oracle, Core Weave, Dell, HPE, Lenovo, ARM and Intel as partners. "We can't have a successful AI industry if the world doesn't think it's built or confident that it's built and deployed safely," Huang told CNBC.