3 ms·
It's the opposite kind of bundling as MoE, which effectively trades memory/storage to save on compute at inference time.
by fy20 2mo ago
It's the opposite kind of bundling as MoE, which effectively trades memory/storage to save on compute at inference time.