3 ms·

A 10 trillion parameter model was mentioned here: https://mobile.twitter.com/ethancaballero/status/1445826862064840713 https://mobile.twitter.com/ethancaballero

• ImprobableTruth 5y ago
  That's MoE.
  • rolisz 5y ago
    Mixture of Experts, aka not all 10 trillion parameters are used at the same time, just a subset that is an "expert" on the "task at hand".
    • jobigoud 5y ago
      That would also describe an organic brain though.