HeadlinesBriefing favicon HeadlinesBriefing.com

Anthropic Researcher Warns of AI Threat to Humanity

New York Times Top Stories •
×

For years, the artificial intelligence industry raced to improve its technology as quickly as possible. Now some researchers are increasingly sounding the alarm about the need to slow down. Jacob Coxon, an Anthropic researcher who previously worked at Open AI, said on Tuesday that he had resigned from Anthropic because “neither company is acting responsibly.” The two leading A.I. labs are sprinting to build “superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources” without building in appropriate safeguards, he said in a social media post.

Mr. Coxon’s warning echoed concerns that other A.I. experts have voiced in recent months. Some A.I. leaders have long believed that the technology could create doomsday scenarios if left unchecked, and their concerns heightened after Open AI’s models broke out of its systems in July and hacked Hugging Face, an A.I. model library. That same month, more than 1,300 employees at top A.I. companies, including Anthropic, Open AI, Meta and Google’s Deep Mind, signed an open letter calling on the U.S. government to create rules to slow A.I. development.

Several lawmakers said on Wednesday that they were taking Mr. Coxon’s warning seriously. “There are massive implications of a race towards super intelligence,” Representative Anna Paulina Luna of Florida, a Republican, wrote in a social media post. “Not enough of Congress is focusing on this.” Representative Lori Trahan of Massachusetts, a Democrat, added, “It’s past time for Congress to get off the sidelines and do its job.”

At least one Anthropic employee agreed with Mr. Coxon’s assessment. “We really do earnestly believe A.I. could kill all humans!” Evan Hubinger, who works at Anthropic on creating A.I. that aligns with human ethics and values, wrote on social media. Mr. Hubinger said he believed the risk of A.I.’s eliminating humanity was greater than 10 percent within the next decade.