3 ms·
Thanks for your advice. > different opinions I won't argue with you so hard if it's your "opinions". What you described is not an opinion. And facts could be
by rfoo 2y ago
Thanks for your advice.
> different opinions
I won't argue with you so hard if it's your "opinions". What you described is not an opinion. And facts could be wrong. Plainly wrong.
> Maybe it's because it is not off?
Yeah, as I said earlier your number might be correct as an estimation for prefilling 1000 tokens on Llama 3 8B. That's not what everybody here called "decode". Your number shows that prefill is compute-bound. So what?