3 ms·

You mean like quantized?

• richardfey 1mo ago
  Yes; or something which has a similar effect.
  • ethbr1 1mo ago
    It would describe the observed behavior. Especially if there were an internal quant/efficiency team that wasn't as diligent about regressions as the primary model team.
  • unclebucknasty 1mo ago
    That's exactly what it feels like and it makes perfect sense, given the known compute constraints.