4 ms·

I'm curious about the computer vision aspect of this tool. Specifically, how was the model which draws bounding boxes around interactable elements trained? Defi

by razfar 3y ago

I'm curious about the computer vision aspect of this tool. Specifically, how was the model which draws bounding boxes around interactable elements trained? Definitely a step beyond existing browser automation software!

suchintan 3y ago
It's surprisingly dumber than you think! I'm always fascinated by how far you can get with heuristics in certain situations. Check out the code here -- https://github.com/Skyvern-AI/skyvern/blob/d0935755963b017ed2d207cfd1087d2fed397d20/skyvern/webeye/scraper/domUtils.js#L654 https://github.com/Skyvern-AI/skyvern/blob/d0935755963b017ed...