3 ms·
Thanks! Nice findings. Is the output, that others can use, the research and findings, or is there a tool or something that came out of this that I can plug in
by kadoban 3mo ago
Thanks! Nice findings.
Is the output, that others can use, the research and findings, or is there a tool or something that came out of this that I can plug in to one of the common harnesses?
I guess that brief note in the twit is that it'll be part of that harness you're opening up in the future?
- ahmadawais 3mo agoThanks! I've seen many developers use the entire tweet as a prompt to improve their harness. If you trace errors, you can find tool call failures per billion tokens. I've seen like many versions of this on pi, oc, or whatnot. This is already live in our hardness command code for almost two months now and we are now fixing one million tool repairs per one trillion tokens. also decided to open source Command Code by v1 release, so hopefully end of the month. https://www.youtube.com/watch?v=laEzOCgtK6c https://www.youtube.com/watch?v=laEzOCgtK6c (live stream on this)
- maxjustus 3mo agohere's a lil pi extension I made yesterday based on it https://gist.github.com/maxjustus/3dd4c83865b1c439e26fdd925b6519e4 https://gist.github.com/maxjustus/3dd4c83865b1c439e26fdd925b...
- ahmadawais 3mo agosee that's what i was saying. in v1 we'll have a super strong extension api — week out probably.