4 ms·
RLHF or DPO are definitely not just the same thing as the basic torch training loop, hence my many more lines of code argument.
by imjonse 3y ago
RLHF or DPO are definitely not just the same thing as the basic torch training loop, hence my many more lines of code argument.