3 ms·

I don't think RLHF datasets need to take full advantage of the context window. There's also many ways to programatically generate NLP datasets.