3 ms·
I'm looking forward to CodeLlama being usable on a Dev system using some CPU offloading and only 32GB _while developing in an IDE_. Code Llama is great but usin
by SillyUsername 3y ago
I'm looking forward to CodeLlama being usable on a Dev system using some CPU offloading and only 32GB _while developing in an IDE_. Code Llama is great but using it alongside an IDE just kicks swapping into overdrive, and at least this will mitigate some of that loss on the LLM generation side (at least for the part in GPU ram).
- vlovich123 3y agoDo you use https://github.com/xNul/code-llama-for-vscode https://github.com/xNul/code-llama-for-vscode or something else? Haven’t found any good setup instructions for Linux or my Google skills are failing me.
- SillyUsername 3y agoI use https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui separately as I code in VS 2022, VS Code, Intellij Idea and Webstorm
- bavell 3y agoI just setup vanilla llama.cpp this past weekend - good place to start as an intro IMO