"Never mind Doom running on a potato, or whatever - the next generation of ridiculous computing belongs to Minecraft YouTuber Sammyuri, who built a working chatbot in the perennially popular voxel building sandbox."
"Dubbed CraftGPT, there's nothing large about the language model and chatbot Sammyuri built inside Minecraft. Trained on the TinyChat dataset and coded in Python, CraftGPT has just 5,087,280 parameters and a vocabulary of 1,920 tokens spread across six layers, making it decidedly a small language model."
"The complete CraftGPT machine - a fully functional computer from the most basic logic gate upward - occupies a massive space of 1,020 x 260 x 1,656 blocks. That's large enough that the Distant Horizons mod had to be installed on the server Sammyuri used to build the system in order to show the whole thing without it falling outside the maximum render distance for the Minecraft engine."
A working chatbot called CraftGPT runs entirely inside Minecraft, built from redstone circuits and Python and trained on the TinyChat dataset. The model contains 5,087,280 parameters, a 1,920-token vocabulary, and six layers, operating as a small language model with a 64-token context window. The in-game computer spans 1,020 x 260 x 1,656 blocks and includes a large display and keyboard, requiring the Distant Horizons mod to render fully. Performance is limited: the model frequently goes off-topic, produces ungrammatical or garbage outputs, and showcased conversations represent its best cases.
Read at Theregister
Unable to calculate read time
Collection
[
|
...
]