3 ms·
I've seen some infographics that shows LLMs practically need to see same data 4 times or less, and once is fine too(trained for one epoch). And I was like, y's
by numpad0 2y ago
I've seen some infographics that shows LLMs practically need to see same data 4 times or less, and once is fine too(trained for one epoch).
And I was like, y'saying, it's a zipped list of edge cases...
- Jensson 2y agoIts a zip with lossy compression for text. First useful lossy text compression algorithm we have made.
- imtringued 2y agoIt was trained that way, so it would be weird if it wasn't.