4 ms·
Coincidentally, or not? A research team just started a 90 day effort to train a 1.1 billion parameter llama model on 3 trillion tokens. https://github.com/jzha
by lumost 3y ago
Coincidentally, or not? A research team just started a 90 day effort to train a 1.1 billion parameter llama model on 3 trillion tokens.
https://github.com/jzhang38/TinyLlama https://github.com/jzhang38/TinyLlama
- yorwba 3y agoNot a coincidence, as your link was submitted 16 hours ago: https://news.ycombinator.com/item?id=37379984 https://news.ycombinator.com/item?id=37379984 and this submission is a top-level repost of a link posted in the comments there.