3 ms·

It looks like it can connect to local models via LiteLLM proxy. Related issue: https://github.com/danny-avila/LibreChat/issues/1131 https://github.com/danny-av

• demosthanos 3y ago
  Good to know, thanks! I still find it a bit concerning that even the LibreChat docs about LiteLLM don't mention local models in the list of use cases. It looks like there's a GitHub ticket to add that to the docs [0], which would be good. Maybe I'm just growing old and crotchety, but it makes me uncomfortable to see a word like Libre—which was specifically coined in English to differentiate itself from Free-as-in-Beer—used in a context where monetary cost seems to be the primary concern in the maintainers' minds. [0] https://github.com/danny-avila/LibreChat/issues/1131 https://github.com/danny-avila/LibreChat/issues/1131