2 ms·
Which is why rubrics as rewards are used.
by jmalicki 4mo ago
Which is why rubrics as rewards are used.
- jgalt212 4mo agostill cost prohibitive.
- jmalicki 4mo agoYes, which is why for some things I've gotten paid as much as $1500 per training example generated. AI labs don't care about cost prohibitive.
- HarHarVeryFunny 4mo agoCould you give a specific example - just the outline/shape of what it consisted of (or more detail if you care to)?
- jmalicki 4mo agoIt was something that took me 8 hours of very hard intellectual work. It was, like some of the higher level contracts, something where I had to create a training example for AI out of whole cloth and prove it was roughly at the boundary of things AIs could solve, and I had to write very detailed rubrics to judge potential solutions and apportion partial credit. I'm not comfortable saying more.
- jgalt212 4mo agoI hope you found writing that response as disatisfying as I found reading it.