We are writing for an AI. Large language models (LLMs) such as ChatGPT have made it possible to automate huge swaths of linguistic life, from summarising any amount of text to drafting emails, essays and even entire novels.
The core part of the job is writing pretend responses to hypothetical chatbot questions. This is the training data that the model needs to be fed. The AI needs an example of what good looks like before it can try to produce good writing.
As well as providing our model with such gold standard material, we are also helping it attempt to avoid hallucinating – a poetic term for telling lies. We do so by feeding it examples that use a search engine and cite sources.
Without seeing writing that does this, it cannot learn to do so by itself. Without better language data, these language models simply cannot improve. Their world is our word.
Collection
[
|
...
]