3 ms·

Yeah but for how long… at this rate I would expect some of the freely distributed models to hit gpt4 levels in as little as 3-6 months.

• int_19h 3y ago
  I've heard claims like that 6 months ago. But so far nobody is even in the same ballpark. And not just freely distributed models, but proprietary ones backed by big money, as well. It really makes one wonder what kind of secret sauce OpenAI has. Surely it can't just be all that compute that Microsoft bought them, since Google could easily match that, and yet...
  • qeternity 3y ago
    > But so far nobody is even in the same ballpark. Miqu is pretty good. Sure, it's a leak...but there's nothing special there. It's just a 70b llama2 finetune.
    • int_19h 3y ago
      By the standards of other llama2 finetunes, sure. Compared to GPT-4, I stand by my previous assertion.
• huytersd 3y ago
  Order of magnitude means they’re going to take 20 times longer to get to the 4. So maybe on the order of 40-60 months from this point.