5 ms·
Robotopia: A 3D, first-person, talking simulator
- 4b11b4 9mo agoI'm imagining a version of this where you have to use various prompt- or data-centric attacks to navigate scenarios
- tom_0 9mo agoWe want to gamify prompt hacking and give people an UI to add/remove chunks of the system prompt. It'll be unlocked by collecting widgets around the place.
- fosterfriends 9mo agoI’m so excited to see LLMs used more creatively in video games. So many new mechanics can be unlocked with LLMs as judges
- psawaya 9mo agoAgreed! Some other cool ones I've seen: https://store.steampowered.com/app/2542850/1001_Nights/ https://store.steampowered.com/app/2542850/1001_Nights/ https://www.playsuckup.com/ https://www.playsuckup.com/
- shminkle 9mo agoRobotopia was very inspired by suck up. First LLM game that kinda cracked the 3d world
- wavemode 9mo agoI like the concept. Though, they couldn't have found better text-to-speech voices? Or is it meant to be humorous how bad they are.
- tom_0 9mo agoIt's a stylistic choice for sure. A little better than that is straight in uncanny valley, and human-level is too high latency and too expensive for us. We found that this level of crappy works great, in practice, plus it runs on-device! We use Rhasspy Piper to generate them.
- Hammershaft 9mo agoI would personally avoid voices that skew too close to common tiktok TTS ai. Currently the heavy robots with the lower bassier voices sell that clunky robot voice vibe much better, but some of the more generic voices immediately take me out.
- tom_0 9mo agoUnfortunately, they are close because some of them ARE tiktok AI voices you heard! I'm working on hiring VAs to make custom datasets, though. We'll have our own unique voices by 1.0 for sure.
- lifetimerubyist 9mo agoAnother game that has LLM powered NPCs is the f2p action game from China called "Where Winds Meet" and players came up with all sorts of hilarious ways to cheat quests and other fun stuff via prompt injections. https://www.dexerto.com/gaming/where-winds-meet-players-are-fooling-ai-npcs-into-giving-them-free-rewards-3288393/ https://www.dexerto.com/gaming/where-winds-meet-players-are-... https://www.rockpapershotgun.com/where-winds-meet-player-convinces-one-of-the-games-npcs-theyre-pregnant-with-his-baby https://www.rockpapershotgun.com/where-winds-meet-player-con...
- shminkle 9mo agoI had no idea this game had LLM NPCs. Interesting
- tom_0 9mo agoHey, Tommaso here, I'm one of the founders of the Robotopia studio. I didn't expect to see this here! Ask me anything :)
- Scaevolus 9mo agoAre the LLMs run on-device, or does this use cloud compute? (Off-topic AMA question: Did you see my voxel grid visibility post?)
- tom_0 9mo agoThe "big" one is Llama3.3-70b on the cloud, right now. On GroqCloud in fact, but we have a cloud router that gives us several backups if Groq abandoned us. We use a ton of smaller models (embeddings, vibe checks, TTS, ASR, etc) and if we had enough scale we'll try to run those locally for users that have big enough GPUs. (You mean the voxel grid visibility from 2014?! I'm sure I did at the time... but I left MC in 2020 so don't even remember my own algorithm right now)
- Scaevolus 9mo agoShipping GPU-accelerated ML models in games looks difficult, are there any major examples other than vendor-locked upscaling like DLSS or FSR? (Yep! https://cod.ifies.com/voxel-visibility/ https://cod.ifies.com/voxel-visibility/ )
- tom_0 9mo agoYeah it's extremely difficult right now, especially for a Windows game that can't have players install Pytorch and the Cuda Toolkit! ONNX and DirectML seem sort of promising right now, but it's all super raw. Even if that worked, local models are bottlenecked by VRAM and that's never been more expensive. And we need to fit 6gb of game in there as well. Even if _that_ worked, we'd need to timeslice the compute inside the frame so that the game doesn't hang for 1 second. And then we'd get to fight every driver in existence :) Basically it's just not possible unless you have a full-time expert dedicated to this IMO. Maybe it'll change! About the voxel visibility: yeah that was awesome, I remember :) Long story short MC is CPU-bound and the frustum clippings' CPU cost didn't get paid off by the reduced overdraw, so it wasn't worth it. Then a guy called Jonathan Hoof rewrote the entire thing to be separated in a 360° scan done on another thread when you changed chunk + a in-frustum walk that worked completely differently, and I don't remember the details but it did fix the ravine issue entirely!
- deleted 9mo ago[deleted]
- johnea 9mo agoMax Headroom?
- malchow 9mo agoThis is an incredible foretaste of what AI can enable in gaming. Not replacing humans (the creators here are former leaders from Minecraft), but rather simply unlocking more fun gameplay by offering creativity, humor, and branched storytelling customized to the player.
- Workaccount2 9mo agoI strongly suspect that the advent of LLMs stalled the new elder scrolls game another 5-6 years.
- malchow 9mo agoWhat's interesting is you might not want to see de novo AI-generated storytelling (slop factor), but you might really like the way AI can make a story crafted by humans more interactive.
- mavamaarten 9mo agoIt's going to be a balance act. There's going to be plenty of companies that are just going to be greedy and will generate AI slop without checking, which will undoubtedly tank the quality of many games in the near future. When applied smartly and with human supervision, I think that AI could easily help humans build game worlds and stories that were previously impossible to achieve.
- tom_0 9mo agoHah from my knowledge of traditional AAA, there is 0 chance any AAA in development right now uses LLMs. A lot of them don't even use it for coding and gamedevs' mood about AI is abysmal.
- Workaccount2 9mo agoLet me just remind you that Microsoft owns the elder scrolls franchise now, for better or worse.
- gimun 9mo agoNice concept and good try!
- tom_0 9mo agoThanks :)
- Rooster61 9mo agoThis looks like a lot of fun. Is there a way to use text rather than speech for input? I'm not particularly fond of my voice getting sent to an LLM.
- tom_0 9mo agoYeah, there's a toggle to type you can switch at any time, it actually lowers latency.