4 ms·
It's interesting to me that they're extracting game state from memory instead of just passing the video into the LLM.
by CSMastermind 1y ago
It's interesting to me that they're extracting game state from memory instead of just passing the video into the LLM.
- _--__--__ 1y agoEvery agent step takes both a visual snapshot and a memory read, the memory gives more consistent tileset and location parsing and also has some stuff like party state/status conditions that isn't usually visible.
- CSMastermind 1y agoShouldn't the goal be to compare it against a human player that would need to menu for that information?
- _--__--__ 1y agothat's probably fair but I imagine that without memory access Claude would have been opening and searching the (completely unordered!) bag to check for progress critical items like the pokeflute every 5 minutes