4 ms·
we have a big dependency on AI, both for developers (can survive without it, mostly habits) and internal workflows (very hard to go without it). So we decided t
by nunodonato 6mo ago
we have a big dependency on AI, both for developers (can survive without it, mostly habits) and internal workflows (very hard to go without it). So we decided to unplug from cloud AI, rent our own GPU and use an open model for both scenarios. We have been very happy with it so far, 60% cheaper and around 50% faster
- scottyah 6mo agoFaster in what way? All the open models we have access to at work are very noticeably behind the frontier models to the point where it's usually faster to not use them at all.
- shimman 6mo agoFaster in which you probably don't have to make so many network requests.
- nunodonato 6mo agoNo, its way way faster than Claude
- htrp 6mo agowhy not an inbetween scenario like using a managed inference provider to host your own models?
- nunodonato 6mo agowhat would be the advantage?