4 ms·
It's the opposite kind of bundling as MoE, which effectively trades memory/storage to save on compute at inference time.
by fy20 22d ago
It's the opposite kind of bundling as MoE, which effectively trades memory/storage to save on compute at inference time.