A dispute over artificial intelligence safety protocols culminated Friday with President Trump ordering U.S. Federal agencies to halt their use of technology from Anthropic, an AI startup. The move came after the Pentagon and Anthropic failed to reach an agreement regarding the use of Anthropic’s Claude AI model.
Pentagon and Anthropic Clash Over AI Use
The core of the conflict centers on Anthropic’s insistence on “red lines” preventing the use of its AI for mass surveillance of Americans or the development of fully autonomous weapons. The Pentagon, however, maintains it should have the freedom to utilize Claude for “all lawful purposes.”
After a Friday evening deadline passed without a resolution, President Trump directed agencies to “immediately” cease using Anthropic’s technology. Defense Secretary Pete Hegseth subsequently designated Anthropic as a “supply chain risk,” instructing military contractors to end commercial activity with the firm.
Anthropic CEO Dario Amodei, in an interview Friday night, affirmed his company’s commitment to working with the military, provided its safety concerns are addressed. “We are still interested in working with them as long as it is in line with our red lines,” he said. Amodei emphasized that Anthropic’s position has remained consistent from the beginning of negotiations.
Amodei explained that Anthropic’s concerns stem from the potential for AI to enable capabilities that clash with American values. He warned that AI could be used to analyze data purchased from private firms for mass surveillance purposes. Regarding autonomous weapons, Amodei expressed concern about reliability and accountability, stating, “We don’t want to sell something that we don’t reckon is reliable, and we don’t want to sell something that could get our own people killed or that could get innocent people killed.”
The Pentagon argues that existing federal law and internal military policies already address Anthropic’s concerns regarding surveillance and autonomous weapons, rendering additional restrictions unnecessary. Emil Michael, the Pentagon’s chief technology officer, stated, “At some level, you have to trust your military to do the right thing.”
Anthropic has indicated it will challenge the “supply chain risk” designation in court, calling the government’s actions “retaliatory and punitive.” The company expects the military to phase out its use of Anthropic’s AI technology within six months, transitioning to an alternative provider.
Frequently Asked Questions
What are Anthropic’s primary concerns?
Anthropic wants to prevent its AI model from being used for mass surveillance of Americans and to power fully autonomous weapons.
What is the Pentagon’s position?
The Pentagon wants the ability to use Anthropic’s AI model for “all lawful purposes” and believes existing laws and policies already address Anthropic’s concerns.
What action has President Trump taken?
President Trump ordered all U.S. Federal agencies to stop using Anthropic’s technology.
As the government and Anthropic remain at odds, how will this impact the future development and deployment of AI within the defense sector?
