3 ms·
Among people who are running large models at home, I think the solution is basically to be rich. Plenty of people in tech earn enough to support a family and d
by michaelt 2y ago
Among people who are running large models at home, I think the solution is basically to be rich.
Plenty of people in tech earn enough to support a family and drive a fancy car, but choose not to. A used RTX 3090 isn't cheap, but you can afford a lot of $1000 GPUs if you don't buy that $40k car.
Other options include only running the smaller LLMs; buying dated cards and praying you can get the drivers to work; or just using hosted LLMs like normal people.