We are entering the era of thought-shaped software

"This dam has to break. It happens that AI is doing a lot the breaking: LLMs' natural language interface is the first of a set of thought-shaped technologies to come into common use. Indeed, we need to make sure that we don't end up with a "same circus, different clowns" story, with a thin layer of natural language (AI/LLMs) on top of the same old exploitation and insult we're used to from technology."

"During times of transition like this, we (the users, people who care but are told to shut up) have the opportunity to take things not usually subject to change - systems, norms, standards - and make them better. I think that our computer interfaces (operating systems, applications, user interfaces) are inhumane, and today we have the opportunity to demand humanity."

Society is transitioning from computer-shaped, to thing-shaped, to thought-shaped interfaces. LLMs' natural language interfaces initiate thought-shaped technologies and risk becoming only a superficial layer atop exploitative legacy systems. Transition periods allow users to change entrenched systems, norms, and standards to be more humane. Current operating systems and applications are inhumane and should be rebuilt to represent human thought rather than control it. The present moment offers opportunity to choose whether software will translate and respect human values or merely mask old power structures.

Read at Medium