4 ms·
Kind of you to respond! Thanks! I have pretty bad ADHD. And I've only run locally using kobold; dilettante at DIY AI. So, yeah, I'm a bit lost in it.
by sleight42 1y ago
Kind of you to respond! Thanks!
I have pretty bad ADHD. And I've only run locally using kobold; dilettante at DIY AI.
So, yeah, I'm a bit lost in it.
- danielhanchen 1y agoOh sorry - for Kobold - I think it uses llama.cpp behind the hood? I think Kobold has some guides on using custom GGUFs