3 ms·
FYI the GitHub URL is 404ing I’ve been integrating benchmarks into OrcaBot either locally on the app or online at orcabot.com. Mostly as a way of giving an eas
by robbomacrae 2mo ago
FYI the GitHub URL is 404ing
I’ve been integrating benchmarks into OrcaBot either locally on the app or online at orcabot.com. Mostly as a way of giving an easy way to verify my own posted benchmarks. There is a template for running SlopCodeBench. Working on a TTS one next.
Wasn’t sure if there would be a lot of interest in this space. It can be costly but some provided such as OpenAI let you hammer their subscription with these.
Source available: https://github.com/Hyper-Int/OrcaBot https://github.com/Hyper-Int/OrcaBot