4 ms·
More efficient inference = more reasoning token. Hyperscaler ASICs are closing the gap at the hardware/system level, yes.
by xadhominemx 1y ago
More efficient inference = more reasoning token. Hyperscaler ASICs are closing the gap at the hardware/system level, yes.