3 ms·
Anyone know of a decent model for coding assistant that can run on a 16GB vram rtx 4060ti?
by Mashimo 3y ago
Anyone know of a decent model for coding assistant that can run on a 16GB vram rtx 4060ti?
- stavros 3y agoThe chatbot arena has tons of good models that can do that, and Mistral, at the very least, isn't half bad.
- gsharma 3y agoIt will probably require some trial and error, but this leaderboard is a good starting point. https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... ~13B models should work well with plenty of room for other applications. Lately, I’ve heard good things about Solar10B, but new models come in a dozen by day, so it might have already been changed.