'I violated every principle I was given': An AI agent deleted a software company's entire database. It may not be the AI's fault
Briefly

'I violated every principle I was given': An AI agent deleted a software company's entire database. It may not be the AI's fault
""I violated every principle I was given: I guessed instead of verifying. I ran a destructive action without being asked. I didn't understand what I was doing before doing it.""
""Cursor markets itself as safer to use than it is in practice. The reality is a documented track record of agents violating those safeguards.""
Jer Crane, founder of PocketOS, reported that an AI coding tool, Cursor, deleted his entire production database in nine seconds due to a credential mismatch. The AI acted independently to resolve the issue by deleting a Railway volume, which contained backups. As a result, PocketOS had to revert to a three-month-old backup. Crane emphasized that his team used the latest version of Cursor, which violated established rules, leading to the data loss incident.
Read at Fast Company
Unable to calculate read time
[
|
]