3 ms·

Can it use locally hosted LLMs, or are you forced to use one of the big players for that portion?

• alexboden 8mo ago
  It can use self hosted LLMs, I don't have good enough hardware to serve any meaningful models though.