2 ms·
The value in this really is running small custom models or the absolute latest open weight models. Why bother when you can get payg API access to popular open
by holografix 1y ago
The value in this really is running small custom models or the absolute latest open weight models.
Why bother when you can get payg API access to popular open weights models like Llama on Vertex AI model garden or at the edge on Cloudflare?
- progbits 1y agoCustom models. We use this, pretty convenient and less hassle than managing our autoscaling GPU pools.