""I continuously find myself reckoning with our situation. The world is in peril. And not just from AI, or bioweapons, but from a whole series of interconnected crises unfolding in this very moment. We appear to be approaching a threshold where our wisdom must grow in equal measure to our capacity to affect the world, lest we face the consequences.""
""In his short time working in AI, he wrote, he had \"repeatedly seen how hard it is to truly let our values govern our actions.\" For now, the self-described \"mystic and ecstatic dance DJ\" - who happened to be one of the world's leading AI risk researchers and had clear visibility into frontier AI models - was stepping away from a lucrative job at a leading firm to \"explore a poetry degree and devote myself to the practice of courageous speech.\"""
""Anthropic has positioned itself as the model-builder most concerned about safety, which, in the context of AI, encompasses more than keeping a platform or service secure or free of bad actors. To work on \"safety\" at an AI company can mean many things. It might mean preventing your models from giving bad advice, reproducing harmful bias, becoming too sycophantic, or being deployed in scams.""
Two high-profile insider developments conveyed deep concern about AI and related global risks. A senior safety researcher resigned, stating the world faces interconnected crises including AI and bioweapons and warning that wisdom must grow alongside technological power to avoid dire consequences. The researcher described difficulty in letting values govern actions and is leaving to study poetry and practice courageous speech. Anthropic frames safety broadly, covering model misuse, bias, sycophancy, scams, and potential biosecurity harms, while also grappling with forward-looking alignment questions about models exceeding human control.
Read at Intelligencer
Unable to calculate read time
Collection
[
|
...
]