2 ms·
Someone brought up an interesting point: to get the latest data (news, scientific breakthroughs...) into the model, you need to constantly retrain it.
by necovek 1y ago
Someone brought up an interesting point: to get the latest data (news, scientific breakthroughs...) into the model, you need to constantly retrain it.
- fennecbutt 1y agoOr, you know, use rag. Which is far better and more accurate than regurgitating compressed training knowledge.
- gmerc 1y agoOh please
- Ianjit 1y agoThe incremental compute costs will scale with the incremental data added, therefore training costs will grow at a much slower rate compared to when training was GPU limited.