3 ms·
Yes, llama.cpp, qwen27b, 35b, claude code. Llama-cpp-manager for managing llama.cpp configs (https://github.com/anubhavgupta/llama-cpp-manager https://github.co
by anubhav200 4mo ago
Yes, llama.cpp, qwen27b, 35b, claude code. Llama-cpp-manager for managing llama.cpp configs (https://github.com/anubhavgupta/llama-cpp-manager https://github.com/anubhavgupta/llama-cpp-manager)
- anubhavgupta 4mo agoMachine: CPU: intel 275hx GPU: Nvidia 5090 Mobile (24GB) RAM: 64GB
- anubhavgupta 4mo agoOne more thing, I also use it along with Whisper-NPU, a speech to text utility that runs on NPU of Intel 275hx and doesn't consumes any GPU resources.
- anubhavgupta 4mo agoWhisper-NPU (https://github.com/anubhavgupta/whisper-npu https://github.com/anubhavgupta/whisper-npu)