3 ms·
I might have missed it, what are the minimum hardware requirements needed to run this?
by tmaly 3y ago
I might have missed it, what are the minimum hardware requirements needed to run this?
- enum 3y agoYou can just about load it on a 32GB GPU in 16bit mode. Quantized versions here: https://huggingface.co/mayank31398/starcoder-GPTQ https://huggingface.co/mayank31398/starcoder-GPTQ they will be benchmarked on humaneval and released soon—maybe tomorrow?