3 ms·
And also this assumes base models. The breakthrough where the instruct/chat models which again are much more code than 500 lines of plain training.
by imjonse 3y ago
And also this assumes base models. The breakthrough where the instruct/chat models which again are much more code than 500 lines of plain training.
- b112 3y agoIt's like claiming a mod on top of an existing game makes it a new game, in a few line if code. It can, but obviously it's the engine and existing code doing all the work.
- hnfong 3y agoWhat are you talking about? Fine tunes are basically just more of the same training, optionally on selected layers for efficiency.
- imjonse 3y agoRLHF or DPO are definitely not just the same thing as the basic torch training loop, hence my many more lines of code argument.