2 ms·
> And even on my meager hardware, I can barely generate 7 token/sec with OpenAI. How are you running a modern OpenAI model on your own hardware?
by rafram 2y ago
> And even on my meager hardware, I can barely generate 7 token/sec with OpenAI.
How are you running a modern OpenAI model on your own hardware?