3 ms·
You can run a local LLM on a $100 minipc with Vulkan GPU acceleration and get a usable token generation count.
by suprjami 2y ago
You can run a local LLM on a $100 minipc with Vulkan GPU acceleration and get a usable token generation count.
loading thread…