4 ms·
tiny NNs distilled from LLMs can produce some amazing results, i'm surprised it's not more common tbh
by electroglyph 1y ago
tiny NNs distilled from LLMs can produce some amazing results, i'm surprised it's not more common tbh
- cpard 1y agoI agree, there are impressive results. This just came out from Berkeley https://arxiv.org/abs/2506.04178 https://arxiv.org/abs/2506.04178 But still, I mainly see work on this direction in academia.