4 ms·
Not per bit or per watt. LLaMA-30B is 16GB and draws 40 watts from a 4090 GPU.
by MacsHeadroom 4y ago
Not per bit or per watt. LLaMA-30B is 16GB and draws 40 watts from a 4090 GPU.
- yunyu 4y agoLLaMa isn't instruction tuned
loading thread…
4 ms·