4 ms·It’s prompt processing so prefill - that’s compute bound not memory.by singhrac 7mo agoIt’s prompt processing so prefill - that’s compute bound not memory.