2 ms·
For AI I think we'll continue to see a series of incremental efficiency improvements like flash attention, MoEs, disaggregated prefill, etc.
by wmf 8mo ago
For AI I think we'll continue to see a series of incremental efficiency improvements like flash attention, MoEs, disaggregated prefill, etc.