4 ms·
How can you disagree with that statement? Training takes significantly more processing power than inference, and typically only the researchers will be doing t
by Sohcahtoa82 3y ago
How can you disagree with that statement? Training takes significantly more processing power than inference, and typically only the researchers will be doing the training, so it makes sense that training costs scale with the number of researchers, as each researcher needs access to their own system powerful enough to perform training.
Inference costs scaling with the number of users is a no-brainer.
I'm pretty dumbfounded how you can just dismiss both statements without giving any reasoning as to why.
EDIT:
> I'm most excited about a future where personalized models are continuously training on my own private data.
This won't be as common as you think.
- visarga 3y ago> typically only the researchers will be doing the training Citizen LLM developers are becoming a thing. Everyone trains (mostly fine-tunes) models today.
- Sohcahtoa82 3y agoNon-technical people will not be fine-tuning models. A service targeted at the masses is unlikely to fine-tune a per-user model. It wouldn't scale without being astronomically expensive.