3 ms·

Mixture of Experts, aka not all 10 trillion parameters are used at the same time, just a subset that is an "expert" on the "task at hand".

• jobigoud 5y ago
  That would also describe an organic brain though.