3 ms·

Both gpt-2 and gpt-4 do that.

• SgtBastard 3y ago
  > we don't need a lot of parameters to build a coherent generative model. GPT-4 is likely to be a trillion+ parameters over its MoR models.