2 ms·
Yes, but I meant it slightly differently than the distills. The idea is to create the next gen SOTA non reasoning model with synthetic reasoning training data.
by spyckie2 2y ago
Yes, but I meant it slightly differently than the distills.
The idea is to create the next gen SOTA non reasoning model with synthetic reasoning training data.
- entropicdrifter 2y agoSo you mean something like, "what if the baseline, off-the-cuff response for the next-gen models was tuned based on the results of the reasoning model excluding the reasoning itself?"
- spyckie2 2y agoExactly, albeit it may need the reasoning later to form the proper foundational logic in the weights.