5 ms·

Awesome. I wonder if you could use this with a game engine or something. Maybe the aici module could render a Nethack screen. And perhaps automatically reject i

by ilaksh 3y ago

Awesome. I wonder if you could use this with a game engine or something. Maybe the aici module could render a Nethack screen. And perhaps automatically reject incorrect command keys in context if they are errors (if integrated deeply enough). Is it possible to combine this with some kind of reinforcement training system?

reissbaker 3y ago
The easiest thing would be to use supervised finetuning on the LLMs you're trying to control (most open-source LLMs have some sort of off-the-shelf system for finetuning), combined with this system to control the output. I suppose there's nothing stopping you from writing an RL training system to alter the model weights other than needing to write a bunch of code, though... Maybe LlamaGym (https://github.com/KhoomeiK/LlamaGym/tree/main https://github.com/KhoomeiK/LlamaGym/tree/main) could reduce the amount of code you need?
gsuuon 3y ago
I'm really excited for LLMs in gaming, like an Ender's Game / Homeworld type game where you can shout orders and the units scramble around or Stellaris where you have actual discussions with the other factions. Local and reliable output enables that sort of stuff, though the perf tradeoff of LLM vs game rendering might be hard to deal with.
- skoocda 3y ago
  Probably worth mentioning Deepmind's SIMA if you haven't seen it yet [0]. It definitely pushes the state of the art for agent behavior in a typical game environment. Perhaps in the future we won't code NPCs any differently from player characters- they'll have access to the full action space, with long-term memory and natural language prompts guiding their behavior. [0]: https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/ https://deepmind.google/discover/blog/sima-generalist-ai-age...

5 ms·

Awesome. I wonder if you could use this with a game engine or something. Maybe the aici module could render a Nethack screen. And perhaps automatically reject i

by ilaksh 3y ago

reissbaker 3y ago
The easiest thing would be to use supervised finetuning on the LLMs you're trying to control (most open-source LLMs have some sort of off-the-shelf system for finetuning), combined with this system to control the output. I suppose there's nothing stopping you from writing an RL training system to alter the model weights other than needing to write a bunch of code, though... Maybe LlamaGym (https://github.com/KhoomeiK/LlamaGym/tree/main https://github.com/KhoomeiK/LlamaGym/tree/main) could reduce the amount of code you need?
gsuuon 3y ago
I'm really excited for LLMs in gaming, like an Ender's Game / Homeworld type game where you can shout orders and the units scramble around or Stellaris where you have actual discussions with the other factions. Local and reliable output enables that sort of stuff, though the perf tradeoff of LLM vs game rendering might be hard to deal with.
- skoocda 3y ago
  Probably worth mentioning Deepmind's SIMA if you haven't seen it yet [0]. It definitely pushes the state of the art for agent behavior in a typical game environment. Perhaps in the future we won't code NPCs any differently from player characters- they'll have access to the full action space, with long-term memory and natural language prompts guiding their behavior. [0]: https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/ https://deepmind.google/discover/blog/sima-generalist-ai-age...