3 ms·
That assumes you have significant work to do between fetches (so you can prefetch while using the current data). With LLM decode you don't.
by EnPissant 7mo ago
That assumes you have significant work to do between fetches (so you can prefetch while using the current data). With LLM decode you don't.