4 ms·you need a faster GPU but that only works for self hosted LLMs (ie: ollama/huggingface)by cranberryturkey 1y agoyou need a faster GPU but that only works for self hosted LLMs (ie: ollama/huggingface)