3 ms·

Wait, were they using the data for training models? I thought that was the case in the first beta for gpt-3.5 long ago (sigh December 2022 feels like ages ago).

• nr2x 3y ago
  It seems they are refining 4 more than planning a 5 based on different interviews. I’m not sure if it matters though, could just be a branding issue more than anything.
  • unsupp0rted 3y ago
    Agreed. I doubt they're allowed to say out loud that they're releasing 5 soon and it'll be as much a step up as 4 was compared to 3.5. They can call it 4.1 but that won't change the outcome.
    • lanstin 3y ago
      they are actively saying 4 represents hitting a limit point for the current models, and that further progress needs different model structure not just more size and training compute. a lot of people are hopeful for the fine tuning but i am sceptical that qualitatively better thinking will happen thru fine tuning, but we'll see