"Anthropic is locked in a paradox: Among the top AI companies, it's the most obsessed with safety and leads the pack in researching how models can go wrong. But even though the safety issues it has identified are far from resolved, Anthropic is pushing just as aggressively as its rivals toward the next, potentially more dangerous, level of artificial intelligence. Its core mission is figuring out how to resolve that contradiction."
"Last month, Anthropic released two documents that both acknowledged the risks associated with the path it's on and hinted at a route it could take to escape the paradox. "The Adolescence of Technology," a long-winded blog post by CEO Dario Amodei, is nominally about "confronting and overcoming the risks of powerful AI," but it spends more time on the former than the latter."
Anthropic combines an intense safety focus with aggressive pursuit of more powerful AI, creating a central paradox. CEO Dario Amodei's essay "The Adolescence of Technology" emphasizes the daunting risks of advanced systems and the danger of authoritarian misuse, adopting a darker tone than his earlier proto-utopian piece but ending on cautious optimism about humanity's resilience. A separate document, "Claude's Constitution," outlines a plan for the Claude chatbot and its successors to follow internal rules and governance, effectively tasking the model itself with helping navigate safety trade-offs. Anthropic intends to use Claude as a tool to reconcile capability growth with risk management.
Read at WIRED
Unable to calculate read time
Collection
[
|
...
]