4 ms·
> Running something internal with 30% GPU utilization is just too cost inefficient compared to using an API. Idk how Reuters will manage to solve this fundament
by hypfer 2mo ago
> Running something internal with 30% GPU utilization is just too cost inefficient compared to using an API. Idk how Reuters will manage to solve this fundamental problem.
That's actually easy, because you can solve it through doing nothing and simply declaring that optimizing for lowest cost is not the main goal.
The fundamental-ness of that problem is entirely man-made and thus can easily be declared void as long as you have the cash to back that up.
Which might be a winning strategy in a world where everyone else is not doing that. Plus that your knowledge stays in-house, etc.