2 ms·

It feels lke they replace older models with "optimised" versions which are cheaper to run, but keep the same name.

• unclebucknasty 1mo ago
  You mean like quantized?
  • richardfey 1mo ago
    Yes; or something which has a similar effect.
    • ethbr1 1mo ago
      It would describe the observed behavior. Especially if there were an internal quant/efficiency team that wasn't as diligent about regressions as the primary model team.
    • unclebucknasty 1mo ago
      That's exactly what it feels like and it makes perfect sense, given the known compute constraints.