3 ms·
> Serving models is currently expensive. I'd argue that some big cloud providers have conspired to make egress bandwidth expensive. Cloudflare R2 has unlimited
by woadwarrior01 2y ago
> Serving models is currently expensive. I'd argue that some big cloud providers have conspired to make egress bandwidth expensive.
Cloudflare R2 has unlimited egress, and AFAIK, that's what ollama uses for hosting quantized model weights.