3 ms·
If you thought crypto miners drove up the prices of GPUs, just wait until a gaming card can host a person who can get a job. Integer-quantized LLaMA can fit on
by sbierwagen 4y ago
If you thought crypto miners drove up the prices of GPUs, just wait until a gaming card can host a person who can get a job.
Integer-quantized LLaMA can fit on a 4090, and isn't quite human-level. If a fully aligned, reliably non-hallucinary turingrade LLM can run on the next generation 5 series GPUs then expect their market price to quadruple or more.