3 ms·
I think the problem is bigger than that too. If you have a problem set where you cannot afford any kind of mistakes LLMs are never going to be the right tool, t
by mdhb 1y ago
I think the problem is bigger than that too. If you have a problem set where you cannot afford any kind of mistakes LLMs are never going to be the right tool, they are never going to get to that stage.
If you have a problem set where some mistakes are tolerable however, all you need to do is slightly increase your tolerance budget for mistakes and you can run something like deepseek locally at a tiny fraction of the cost.
Which means these giant data centers are useful for training but the economics of running ongoing inference for customers doesn’t make long term sense for the vast majority of people.
Which leaves you with a huge huge huge financial problem, one which may have devastating large scale impacts on the economy.