4 ms·
Basically enough to fit the download in RAM + a bit more. In practice, you kinda need a GPU, even a small one. Otherwise prompt processing is really slow.
by brucethemoose2 3y ago
Basically enough to fit the download in RAM + a bit more.
In practice, you kinda need a GPU, even a small one. Otherwise prompt processing is really slow.
- wazoox 3y agoIt's really decent without any GPU. Image analysis is somewhat long, but text prompts are fine. My Ryzen laptop does 2.5 to 4 tokens per second, my Mac pro more like 8.