3 ms·
What are you talking about? Fine tunes are basically just more of the same training, optionally on selected layers for efficiency.
by hnfong 3y ago
What are you talking about? Fine tunes are basically just more of the same training, optionally on selected layers for efficiency.
- imjonse 3y agoRLHF or DPO are definitely not just the same thing as the basic torch training loop, hence my many more lines of code argument.