3 ms·
Working on benchmarks at the moment! Always open to feedback / PRs.
by softservo 5mo ago
Working on benchmarks at the moment! Always open to feedback / PRs.
- carterschonwald 5mo agoim def working on benchmarks for how my own general harness improves task performance vs same model in a commodity setup. its hard to do! i will say that my current harness: https://github.com/cartazio/oh-punkin-pi https://github.com/cartazio/oh-punkin-pi is a testbed for a bunch of 2nd gen harness tech, largely optimized for reasoning llms only. the next one after this harness is gonna be epicccc