3 ms·
I'm not asking for actual examples, but what kind of thing is in your internal reasoning benchmark?
by sebzim4500 2y ago
I'm not asking for actual examples, but what kind of thing is in your internal reasoning benchmark?
- freediver 2y agoThings like “summarize this text in exactly 14 words”, programming questions, unstructured data to structured data transformations and so on…
- sebzim4500 2y agoDo you let it use CoT? I think that first one is pretty hard if you have to produce it directly one token at a time, but I guess that's kind of the point.