Dario Amodei, CEO of Anthropic, has acknowledged that the functioning of AI systems is still largely a mystery, with developers unable to pinpoint why AI makes certain decisions. He outlined plans for an "MRI on AI" aimed at demystifying AI technology and addressing potential risks. Amodei's insights highlight a critical concern within the AI community, particularly following his departure from OpenAI due to safety practice issues. His firm, Anthropic, seeks to prioritize safety as a central tenet of AI development moving forward.
When a generative AI system does something, like summarize a financial document, we have no idea, at a specific or precise level, why it makes the choices it does.
This lack of understanding is essentially unprecedented in the history of technology.
Anyone alarmed by that ignorance is right to be concerned.
The ignorance about how AI works and what unforeseen risks it may pose is a driving factor behind Anthropic.
Collection
[
|
...
]