Anthropic to Pentagon: Robo-weapons could hurt US troops
Briefly

Anthropic to Pentagon: Robo-weapons could hurt US troops
"However, in a narrow set of cases, we believe AI can undermine, rather than defend, democratic values. Amodei said two items in Anthropic's contract with the department of war are simply outside the bounds of what today's technology can safely and reliably do. One of those use cases is mass domestic surveillance, which Amodei said can now create a comprehensive picture of any person's life-automatically and at massive scale with the help of AI."
"Today, frontier AI systems are simply not reliable enough to power fully autonomous weapons. We will not knowingly provide a product that puts America's warfighters and civilians at risk. The CEO said Anthropic has offered to work directly with the Department of War on R&D to improve the reliability of these systems."
"Anthropic understands that the Department of War, not private companies, makes military decisions. We have never raised objections to particular military operations nor attempted to limit use of our technology in an ad hoc manner. However, in a narrow set of cases, we believe AI can undermine, rather than defend, democratic values."
Anthropic has rejected the US Department of War's demand to remove safety guardrails from its Claude AI technology for military applications. CEO Dario Amodei stated the company will not comply despite threats of contract cancellation and penalties. Anthropic distinguishes between respecting military decision-making authority and refusing specific use cases it deems unsafe. Two primary concerns are mass domestic surveillance, which AI can now conduct comprehensively at scale, and fully autonomous weapons systems. Amodei argues current AI systems lack sufficient reliability for autonomous weapons deployment and pose risks to American warfighters and civilians. Anthropic has offered to collaborate on research and development to improve system reliability but maintains its refusal to deploy unsafe technology.
Read at Theregister
Unable to calculate read time
[
|
]