2 ms·
Where did you get the 700 gigabytes figure from? I don't think OpenAI even released the model size, although it's considered to be 175B parameters. Given how we
by M4v3R 3y ago
Where did you get the 700 gigabytes figure from? I don't think OpenAI even released the model size, although it's considered to be 175B parameters. Given how well quantization works at these sizes you would need less than 200 GB of GPU memory to run it.