3 ms·

RLHF wasn't needed for Deepseek, only gobbling up the whole internet — both good and bad stuff. See their paper