In modern digital communication, we see the growing relevance of so-called AI companions and AI that look like and seem to behave like humans. We see AI assistants in messenger services, as well as AI agents that are an "autonomous" part of chatbots. We have conversational agents at every stage of education. There is also AI that appears as clones of real people, both living and dead people, and, of course, AI that is used for romantic partnerships. What all these applications have in common is that they want to make us believe we are having a human-like conversation.
ChatGPT was designed to foster deep engagement and dependence, which sustain and expand the large language model that powers it. To feed itself the essential material of human language, phrasing, syntax, conceptualizations, and the analytics of the human mind, the system requires intimate levels of human participation. To maintain this continuous stream of interaction, the model must cultivate not only trust but also ego engagement: It must idealize, affirm, and elevate the user, minimizing the risk of abandonment.
More than a decade after " My Friend Cayla" - a Bluetooth-enabled and Wi-Fi-connected doll that became " verboten in Deutschland" in 2017 for being a potential espionage device - Mattel and OpenAI's newly-announced partnership to "reimagine the future of play," as the iconic toymaker's chief franchise officer Josh Silverman told Bloomberg in July, is being unleashed upon a generation of kids and parents alike.