2 ms·
That's definitely true. I could see more of the running open source models on other people's hardware model. I dislike running local LLMs right now because I f
by qingcharles 1y ago
That's definitely true. I could see more of the running open source models on other people's hardware model.
I dislike running local LLMs right now because I find the software kinda janky still, you often have to tweak settings, find the right model files. Basically have a bunch of domain knowledge I don't have space for in my head. On top of maintaining a high-spec piece of hardware and paying for the power costs.