25 ms·

LibreChat – Enhanced ChatGPT Clone

98 points by jacopoj 3y ago

Retr0id 3y ago
Not to be confused with https://libera.chat/ https://libera.chat/
- deleted 3y ago
  [deleted]
treyd 3y ago
Name is kinda misleading, I thought it was a messaging client/protocol.
- ranting-moth 3y ago
  Kinda? It's blatantly dishonest.
- deleted 3y ago
  [deleted]
bobse 3y ago
[dead]
bayesianbot 3y ago
I have been wondering why I haven't really found good self-hosted UIs that could also use plugins / functions. Just installed this (which was quite easy) and it seems to work very well! Definitely gonna replace the one I was using before.
jraph 3y ago
It's an open source client for ChatGPT. (From the naming, I was expecting some "strongly free software", like LibreJS, Libreboot, linux-libre, which would not rely on something closed like ChatGPT - I guess if someone made a free LLM-based chat, they could call it ChatGPL (though they should probably not, too close to ChatGPT)) If I'm ever stuck in a situation where I need to use ChatGPT, I'll consider using LibreChat :-)
- qup 3y ago
  > AI model selection: OpenAI API, BingAI, ChatGPT Browser, PaLM2, Anthropic (Claude), Plugins
demosthanos 3y ago
The primary use case here seems to be that it might be possible to use this tool to spend <$20/mo for the same feature set as ChatGPT+. It does not currently make any effort to support locally-hosted open source models, which is what I would have assumed from its name. If you're interested in a fully Libre LLM stack, I've had fun lately with ollama [0] and ollama-webui [1]. It was pretty trivial to take ollama-webui's docker-compose file and set up a locally-running chat server with Mistral 7B. Trying out different models and prompts was likewise very easy to get started with. Mistral isn't anything like as good as GPT-4, but it's Apache licensed and fully local, which meets my definition of Libre. I'll continue to use both while the FOSS stacks catch up, but it's fun to keep up with the progress on the open source stuff as tooling develops. [0] https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama [1] https://github.com/ollama-webui/ollama-webui https://github.com/ollama-webui/ollama-webui
- cloudking 3y ago
  It looks like it can connect to local models via LiteLLM proxy. Related issue: https://github.com/danny-avila/LibreChat/issues/1131 https://github.com/danny-avila/LibreChat/issues/1131 LiteLLM: https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm Guide: https://github.com/danny-avila/LibreChat/blob/main/docs/install/litellm.md https://github.com/danny-avila/LibreChat/blob/main/docs/inst...
  - demosthanos 3y ago
    Good to know, thanks! I still find it a bit concerning that even the LibreChat docs about LiteLLM don't mention local models in the list of use cases. It looks like there's a GitHub ticket to add that to the docs [0], which would be good. Maybe I'm just growing old and crotchety, but it makes me uncomfortable to see a word like Libre—which was specifically coined in English to differentiate itself from Free-as-in-Beer—used in a context where monetary cost seems to be the primary concern in the maintainers' minds. [0] https://github.com/danny-avila/LibreChat/issues/1131 https://github.com/danny-avila/LibreChat/issues/1131
MrsPeaches 3y ago
Decent list of UIs (includes LibreChat): https://github.com/korchasa/awesome-chatgpt https://github.com/korchasa/awesome-chatgpt
SubiculumCode 3y ago
Libre ... seems to be co-opting the term a bit if it you can't run your llm local What does this have that kobold.cpp, llama.cpp backends + sillytavern et al frontends with one of the thousand llm weights won't give you? For entertainment, these offer simultaneous llm output with methods to retain context, allows outputs that can be vocalized via TTS voice simulation, inputs via mucrophone, and can provide illustrations of content via stable diffusion, and allow multiple chat bot "characters" to be in the same conversation, all of which honestly gets a bit surreal.
footlose_3815 3y ago
Like other are saying, I was expecting something that's not an interface to other chatbots.
wyldfire 3y ago
Is this truly open source? I mean, beyond just the UI/environment. A lot of AI models seem to be gratis-but-not-libre. It's great that they're even gratis but I'm curious just how libre this is overall. I'm not being critical - just curious.
yieldcrv 3y ago
very cool! at first it looks like a lot to avoid spending $20/month but I realize I am already using LM Studio, which has a language model browser in it and lets you hot swap them in, in a nice single click GUI. Most notably, it also lets you switch to server mode and accepts and serves requests in the OpenAI REST format, across my local network or simply my main machine on various ports. so some privacy and multimodal is great. glad the pieces are getting more user friendly to casually use
the__prestige 3y ago
OpenAI trains with my chat if I enable history. I absolutely need history so that I can use it as an intelligent diary or note taker. I absolutely don’t want it to train with my data. On the other hand, they dont train with API usage. So something like this is very interesting. Question: does LibreChat support importing OpenAI history?
aldarisbm 3y ago
nothing libre about this
eko21 3y ago
Totally misleading. What you actually are looking for is gpt4all: https://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all
lorepieri 3y ago
Check https://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all instead.

98 points by jacopoj 3y ago

Retr0id 3y ago

Not to be confused with https://libera.chat/ https://libera.chat/

deleted 3y ago
[deleted]

treyd 3y ago

Name is kinda misleading, I thought it was a messaging client/protocol.

ranting-moth 3y ago
Kinda? It's blatantly dishonest.
deleted 3y ago
[deleted]

bobse 3y ago

[dead]

bayesianbot 3y ago

I have been wondering why I haven't really found good self-hosted UIs that could also use plugins / functions. Just installed this (which was quite easy) and it seems to work very well! Definitely gonna replace the one I was using before.

jraph 3y ago

It's an open source client for ChatGPT. (From the naming, I was expecting some "strongly free software", like LibreJS, Libreboot, linux-libre, which would not rely on something closed like ChatGPT - I guess if someone made a free LLM-based chat, they could call it ChatGPL (though they should probably not, too close to ChatGPT)) If I'm ever stuck in a situation where I need to use ChatGPT, I'll consider using LibreChat :-)

qup 3y ago
> AI model selection: OpenAI API, BingAI, ChatGPT Browser, PaLM2, Anthropic (Claude), Plugins

demosthanos 3y ago

The primary use case here seems to be that it might be possible to use this tool to spend <$20/mo for the same feature set as ChatGPT+. It does not currently make any effort to support locally-hosted open source models, which is what I would have assumed from its name. If you're interested in a fully Libre LLM stack, I've had fun lately with ollama [0] and ollama-webui [1]. It was pretty trivial to take ollama-webui's docker-compose file and set up a locally-running chat server with Mistral 7B. Trying out different models and prompts was likewise very easy to get started with. Mistral isn't anything like as good as GPT-4, but it's Apache licensed and fully local, which meets my definition of Libre. I'll continue to use both while the FOSS stacks catch up, but it's fun to keep up with the progress on the open source stuff as tooling develops. [0] https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama [1] https://github.com/ollama-webui/ollama-webui https://github.com/ollama-webui/ollama-webui

cloudking 3y ago
It looks like it can connect to local models via LiteLLM proxy. Related issue: https://github.com/danny-avila/LibreChat/issues/1131 https://github.com/danny-avila/LibreChat/issues/1131 LiteLLM: https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm Guide: https://github.com/danny-avila/LibreChat/blob/main/docs/install/litellm.md https://github.com/danny-avila/LibreChat/blob/main/docs/inst...
- demosthanos 3y ago
  Good to know, thanks! I still find it a bit concerning that even the LibreChat docs about LiteLLM don't mention local models in the list of use cases. It looks like there's a GitHub ticket to add that to the docs [0], which would be good. Maybe I'm just growing old and crotchety, but it makes me uncomfortable to see a word like Libre—which was specifically coined in English to differentiate itself from Free-as-in-Beer—used in a context where monetary cost seems to be the primary concern in the maintainers' minds. [0] https://github.com/danny-avila/LibreChat/issues/1131 https://github.com/danny-avila/LibreChat/issues/1131

MrsPeaches 3y ago

Decent list of UIs (includes LibreChat): https://github.com/korchasa/awesome-chatgpt https://github.com/korchasa/awesome-chatgpt

SubiculumCode 3y ago

Libre ... seems to be co-opting the term a bit if it you can't run your llm local What does this have that kobold.cpp, llama.cpp backends + sillytavern et al frontends with one of the thousand llm weights won't give you? For entertainment, these offer simultaneous llm output with methods to retain context, allows outputs that can be vocalized via TTS voice simulation, inputs via mucrophone, and can provide illustrations of content via stable diffusion, and allow multiple chat bot "characters" to be in the same conversation, all of which honestly gets a bit surreal.

footlose_3815 3y ago

Like other are saying, I was expecting something that's not an interface to other chatbots.

wyldfire 3y ago

Is this truly open source? I mean, beyond just the UI/environment. A lot of AI models seem to be gratis-but-not-libre. It's great that they're even gratis but I'm curious just how libre this is overall. I'm not being critical - just curious.

yieldcrv 3y ago

very cool! at first it looks like a lot to avoid spending $20/month but I realize I am already using LM Studio, which has a language model browser in it and lets you hot swap them in, in a nice single click GUI. Most notably, it also lets you switch to server mode and accepts and serves requests in the OpenAI REST format, across my local network or simply my main machine on various ports. so some privacy and multimodal is great. glad the pieces are getting more user friendly to casually use

the__prestige 3y ago

OpenAI trains with my chat if I enable history. I absolutely need history so that I can use it as an intelligent diary or note taker. I absolutely don’t want it to train with my data. On the other hand, they dont train with API usage. So something like this is very interesting. Question: does LibreChat support importing OpenAI history?

aldarisbm 3y ago

nothing libre about this

eko21 3y ago

Totally misleading. What you actually are looking for is gpt4all: https://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all

lorepieri 3y ago

Check https://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all instead.