3 ms·
Mistral-7B Playing Doom
- achrono 3y agoWould be really neat to extend this to have Doom on an LLM. Much of AI has been enabled by gaming, and this could be the crowning synergy.
- dartos 3y agoLLMs aren’t computers. What do you mean doom on an llm?
- bitwize 3y ago"You are a cacodemon. Your objective is to kill the Doom Slayer using a combination of your ranged ball lightning attack and a bite at close range. For each frame of input, select the response that represents the best course of action to achieve this goal at the time of that frame."
- jasonjmcghee 3y agoRelated / previous discussion https://news.ycombinator.com/item?id=39813174 https://news.ycombinator.com/item?id=39813174
- aussieguy1234 3y agoI always thought that in terms of getting the current generation of LLMs to do useful actions on a computer, we need to go back to console applications since they can't yet interpret GUIs but are perfectly fine with text. This seems to be an example. I'd be interested to see how an LLM might go with an ancient console based spreadsheet or word processing app. Could they then replace humans using modern versions of those same apps?
- sho_hn 3y agoI've done some experiments with a little camera-equipped robot navigating by prompting a LMM with stills and producing captions that include military-style o'clock directions. Some promising results with a weekend of tinkering. I'm sure one could play Doom that way, too.
- danmur 3y agoI'd love to give my robot vac water gun abilities so it can defend itself from cat attacks. One day.
- Animats 3y agoOh, that's what the Doom-playing program sees as a representation. That's very clever.