4 ms·
Of course if you arrive last and copy all the existing architecture you can train it cheaper
by arisAlexis 2y ago
Of course if you arrive last and copy all the existing architecture you can train it cheaper
- viraptor 2y agoNo, you can only train at the same cost then. (Actually higher, because you don't have the existing hardware/power agreements) The whole point of the last model was that they made significant changes beyond just copying.
- arisAlexis 2y agoNo because you can train once and avoid all the errors that are costly and make you train and retrain.
- msp26 2y ago> copy You mean build on existing public research? Everyone does that. At least deepseek, meta etc. also have the decency to publish research back into this ecosystem.