3 ms·
Chosen expert (on each layer) depends on the input of previous layer. Not sure how you can preload the experts before forward pass.
by boroboro4 2y ago
Chosen expert (on each layer) depends on the input of previous layer. Not sure how you can preload the experts before forward pass.