5 ms·
Well, TinyChat. Still mind-boggling. From the video description: I built a small language model in Minecraft using no command blocks or datapacks! The m
by jweather 1y ago
Well, TinyChat. Still mind-boggling. From the video description:
I built a small language model in Minecraft using no command blocks or datapacks!
The model has 5,087,280 parameters, trained in Python on the TinyChat dataset of basic English conversations. It has an embedding dimension of 240, vocabulary of 1920 tokens, and consists of 6 layers. The context window size is 64 tokens, which is enough for (very) short conversations. Most weights were quantized to 8 bits, although the embedding and LayerNorm weights are stored at 18 and 24 bits respectively. The quantized weights are linked below; they are split into hundreds of files corresponding to the separate sections of ROM in the build.
The build occupies a volume of 1020x260x1656 blocks. Due to its immense size, the Distant Horizons mod was used to capture footage of the whole build; this results in distant redstone components looking strange as they are being rendered at a lower level of detail.
It can produce a response in about 2 hours when the tick rate is increased using MCHPRS (Minecraft High Performance Redstone Server) to about 40,000x speed.
- jweather 1y agoIt would take just over 9 years for a response at the normal redstone tick rate... sounds about right.
- throwup238 1y agoThe Minecraft AI Challenge: can your LLM company reach profitability before Minecraft can predict a token?
- athrowaway3z 1y agoThis can be achieved today. Microsoft owns Minecraft; so they'll just swirl the numbers together with Minecraft sales to show their AI is already profitable.
- rightbyte 1y ago> no command blocks Oh. I thought this would be some cheesy command block curl to Chat GPT.
- lhamil64 1y agoAs far as I'm aware there's no way to do an HTTP request via command blocks, at least in vanilla.
- datadrivenangel 1y agoThrough Lua, all things are possible
- charcircuit 1y agoThe scripting language for Minecraft is Typescript. Lua would require a 3rd party mod. https://learn.microsoft.com/en-us/minecraft/creator/scriptapi/minecraft/server-net/minecraft-server-net?view=minecraft-bedrock-experimental https://learn.microsoft.com/en-us/minecraft/creator/scriptap... >The @minecraft/server-net module contains types for executing HTTP-based requests. This module can only be used on Bedrock Dedicated Server. These APIs do not function within the Minecraft game client or within Minecraft Realms.
- ianhawes 1y ago* In Bedrock Edition. Minecraft purists only use Java Edition.