2 ms·
So they use cog before installing it? Apparently this wasn’t proofread. Also, is it just me or there are currently more ways to run LLMs on a CPU than on a GPU
by rcarmo 4y ago
So they use cog before installing it? Apparently this wasn’t proofread.
Also, is it just me or there are currently more ways to run LLMs on a CPU than on a GPU springing up on GitHub? I have hacked my own, but my chat UI is awful, so what is the nicest, pre-packaged CUDA-friendly way to run this now?