4 ms·
It might the time mentioned at the bottom of the page since the author isn't sure that the GPU is being used: >How to speed this up—right now my Llama prompts
by lm2s 3y ago
It might the time mentioned at the bottom of the page since the author isn't sure that the GPU is being used:
>How to speed this up—right now my Llama prompts often take 20+ seconds to complete.