4 ms·

I have a 2070 and can confirm it works amazingly fast. I love TheBloke I wish he still made stuff

• ge96 5mo ago
  What do you use it for? I'm still trying to use agents, I barely use copilot, only at work when I have to. I didn't want to get personal with an LLM unless it was local so that's why I was setting this up but yeah. So far just research is what I was looking at.
• bashbjorn 5mo ago
  Yeah, TheBloke era of local LLMs were good times. TBF Unsloth are doing a fantastic job of publishing quants of the major models quickly - they just don't have nearly the volume of "weird" models as TheBloke did.
• paradox460 5mo ago
  A lot of the same spirit lives on in TheDrunmer They're mostly aimed at role play and sillytavern, but they're still generally good models, with lots of quants available