5 ms·
The open source community has breakthrough after breakthrough lately. its absolutely stunning how fast it's advancing. I can run art models and llms on cpu/gpu
by stuckinhell 3y ago
The open source community has breakthrough after breakthrough lately. its absolutely stunning how fast it's advancing.
I can run art models and llms on cpu/gpu now. I've tested out opensource models with quality better than chatgpt3.5turbo, and I can even fine tune them on my notes and books for better results. It's all so easy with so many one click installers now too!
My husbands D&D group uses some AI for their games now (koboldcpp?).
It's staggering how fast it's moving.
- jprete 3y ago> I can run art models and llms on cpu/gpu now. I've tested out opensource models with quality better than chatgpt3.5turbo, and I can even fine tune them on my notes and books for better results. It's all so easy with so many one click installers now too! Do you have a good resource to find this stuff? I’m behind the times. (Also, to be a pedant, most of that is inference and not training. But I can’t say much about fine tuning so I’m not really trying to argue against your point.)
- stuckinhell 3y agoHonestly no good single resource, I spend 8 hours a week just taking notes from hackernews,discord, hackernoon, slack ai groups, reddit, github issues (probably the most useful) on various open source ai libraries. It's real work to keep up on everything.