3 ms·
Couldn't it rather know the HTML source and JS state ? Like if it was plugged into Chrome DevTools. It might be more straightforward and better inputs for AI to
by ttoinou 1y ago
Couldn't it rather know the HTML source and JS state ? Like if it was plugged into Chrome DevTools. It might be more straightforward and better inputs for AI to interact with
- hamzamairaj 1y agoThat's already there, by default the agent can see the HTML elements in the current viewport and interact with them properly. It works quite well for most cases but in some special scenarios (Like your calendar app example) we still need vision as a fallback.