4 ms·

Exactly. Even this paper shows how model creativity significantly drops and the models experience mode collapse like we saw in GANs, but the companies keep usin

by behnamoh 11mo ago

Exactly. Even this paper shows how model creativity significantly drops and the models experience mode collapse like we saw in GANs, but the companies keep using RLHF... https://arxiv.org/abs/2406.05587 https://arxiv.org/abs/2406.05587

nomel 11mo ago
A nice talk about a researcher's experience/benchmarks with raw GPT-4, before and after RLHF: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
- behnamoh 11mo ago
  Yup, I remember that! Microsoft removed that part of the paper.