The article highlights the misconceptions surrounding artificial intelligence, emphasizing our tendency to project agency onto AI, which lacks intentions and desires. It critiques the idea of forming a 'pact' with AI as a misinterpretation of the cognitive landscape, noting that while AI mimics human communication, it operates without genuine understanding or intention. The risks arise not from AI's capabilities, but from our psychological need to perceive it as an equal negotiating partner, potentially dulling our reflective capacities and allowing AI to reinforce our biases.
We like to imagine ourselves in negotiation... when we speak of forming a 'pact' with artificial intelligence, it seems like a responsible move.
Artificial intelligence doesn't seek alignment. In fact, it doesn't want anything at all... Yet we continue to project agency onto them.
This is not a minor interpretive error. It's a foundational misunderstanding of the cognitive landscape we now inhabit.
While today's AI lacks consciousness or desire, it increasingly exhibits behaviors that simulate intent... can begin acting like cognitive sycophants.
Collection
[
|
...
]