3 ms·
You can use things like Browser Use and Playwright to hook things like that up, but you’re right, this is a very underdeveloped area. Armin Ronacher has a talk
by JimDabell 1y ago
You can use things like Browser Use and Playwright to hook things like that up, but you’re right, this is a very underdeveloped area. Armin Ronacher has a talk that covers some of this, such as unifying console.log, server logs, SQL, etc. to feed back to the LLM.
https://www.youtube.com/watch?v=nfOVgz_omlU https://www.youtube.com/watch?v=nfOVgz_omlU
- wahnfrieden 1y agoThis is the way. You can also feed screenshots back to it.
- dcchuck 1y agoMy experience with the off the shelf MCP tools is they still fall short of giving Claude or Codex a screenshot. I'm interested in whether or not others agree.
- wahnfrieden 1y agoMCP or CLI (called by agent) can also be used to generate the screenshot input loop
- dcchuck 1y agoYes, but image size restrictions bring more failure than success in my experience. Thank you for your comment.