2 ms·
No, training a state of the art model involves training on the order of 10 trillion tokens. We're talking about a step that updates weights based on say betwee
by colechristensen 5mo ago
No, training a state of the art model involves training on the order of 10 trillion tokens.
We're talking about a step that updates weights based on say between 10k and 1M tokens.
- delis-thumbs-7e 5mo agoI learned something. Thank you!