"This is an example of a potential future in which AI CEOs, not democratically elected leaders, decide what's acceptable. In a democracy, voters can remove an elected official who makes bad decisions. But if a CEO makes a harmful choice, especially one that boosts revenue or profit, the public has little recourse. Shareholders, not voters, determine whether CEOs keep their jobs."
"It does not sound crazy to a Silicon Valley executive that maybe they could be in charge instead of you. If they actually could control superintelligence, they'd discard you like used toilet paper. Whatever Amodei or other AI leaders say, corporations exist to generate returns. Investors pour billions into Anthropic, expecting enormous future profits."
"Anthropic's own decisions reflect these tensions. In late February, it scrapped a prior commitment to pause scaling or delay deploying models if safety measures lagged behind capabilities - a striking shift for a company whose CEO frequently warns about runaway AI risks."
Anthropic's refusal to allow the Pentagon unrestricted use of its AI systems exemplifies a broader conflict between AI companies and governments over who controls powerful technology. CEO Dario Amodei restricted military applications citing concerns about domestic surveillance and autonomous weapons, potentially overriding government legal determinations. This raises fundamental questions about democratic accountability: elected officials can be removed by voters for poor decisions, but corporate leaders answer only to shareholders. Despite rhetoric about safety and ethics, corporations prioritize profit generation. Anthropic's recent decisions—abandoning safety scaling commitments and reversing positions on Middle Eastern investment—demonstrate how financial pressures override stated principles, suggesting AI companies may increasingly dictate acceptable technology uses rather than elected governments.
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]