4 ms·

The "alignment tax".

• behnamoh 11mo ago
  Exactly. Even this paper shows how model creativity significantly drops and the models experience mode collapse like we saw in GANs, but the companies keep using RLHF... https://arxiv.org/abs/2406.05587 https://arxiv.org/abs/2406.05587
  • nomel 11mo ago
    A nice talk about a researcher's experience/benchmarks with raw GPT-4, before and after RLHF: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
    • behnamoh 11mo ago
      Yup, I remember that! Microsoft removed that part of the paper.