4 ms·
> As proof, ABP with opus 4.6 as the driver scores 90.5% on the Online Mind2Web benchmark And what does opus score with "regular" browser harnesses?
by Retr0id 8mo ago
> As proof, ABP with opus 4.6 as the driver scores 90.5% on the Online Mind2Web benchmark
And what does opus score with "regular" browser harnesses?
- esafak 8mo agohttps://huggingface.co/spaces/osunlp/Online_Mind2Web_Leaderboard https://huggingface.co/spaces/osunlp/Online_Mind2Web_Leaderb...
- Retr0id 8mo agoHm I can't see Opus 4.6 on there
- theredsix 8mo agoI tweeted at the OSUNLP and they're backed up on eval validation. In the meantime, here's the benchmark repo with the saved runs and also instructions on how to run it locally. https://github.com/theredsix/abp-online-mind2web-results https://github.com/theredsix/abp-online-mind2web-results
- 9wzYQbTYsAIc 8mo ago90% easy or 90% average?
- theredsix 8mo ago90% average with 85.51% hard!
- 9wzYQbTYsAIc 8mo agoNice! Will take a look at this for my homelab - was debating using crawl.cloudflare.com to try it out, as browser rendering was my next stretch goal.