That's true - state serialization can definitely help. > AI has been getting pretty decent at analyzing images (screenshots/renders). I've found AI to be hit

That's true - state serialization can definitely help. > AI has been getting pretty decent at analyzing images (screenshots/renders). I've found AI to be hit or miss on this - especially if the image is busy with lots of elements. They're really good at ad-hoc OCR but struggle more with 3d visualizations in a game that might be using WebGL. For example, setting up the light sources (directional, lightmaps, etc) in my 3D chess game to ensure everything looked well-lit while also minimizing harsh specular reflections was something VLMs (tested with Claude and Gemini) failed pretty miserably at. https://shahkur.specr.net https://shahkur.specr.net