2 ms·
Also just LLMs getting more efficient in general can lead to the end of the GPU buying frenzy
by fckgw 1y ago
Also just LLMs getting more efficient in general can lead to the end of the GPU buying frenzy
- bigyabai 1y agoI don't really buy it. If you can get GPT-3 performance out of a 4B parameter model, then people are going to use the GPUs for even higher-quality remote inference.