3 ms·
WizardCoder is probably close to state of the art for open models as of right now. https://github.com/nlpxucan/WizardLM/tree/main/WizardCoder https://github.co
by voiceblue 3y ago
WizardCoder is probably close to state of the art for open models as of right now.
https://github.com/nlpxucan/WizardLM/tree/main/WizardCoder https://github.com/nlpxucan/WizardLM/tree/main/WizardCoder
https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0 https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0
Top of the line consumer machines can run this at a good clip, though most machines will need to use a quantized model (ExLlamaV2 is quite fast). I found a model for that as well, though I haven't used it myself:
https://huggingface.co/oobabooga/CodeBooga-34B-v0.1-EXL2-4.250b https://huggingface.co/oobabooga/CodeBooga-34B-v0.1-EXL2-4.2...