3 ms·

Tangentially, I lowered my personal cost by more than 3x, and was able to share GPT-4 with my friends and family. I installed LibreChat on a Linode droplet, pu

Tangentially, I lowered my personal cost by more than 3x, and was able to share GPT-4 with my friends and family. I installed LibreChat on a Linode droplet, put $10 on my OpenAI account for API usage, and cancelled my ChatGPT subscription. Since neither I, nor my friends and family use ChatGPT a ton, I let them sign up on my server and the API costs are under $1 so far.

infecto 3y ago
I actually think this is the way. ChatGPT honestly is not that great. I would be happy to pay per token for ChatGPT and be able to have a little more control over the system messages.
- CuriouslyC 3y ago
  If you regularly use GPT4 for coding this isn't so viable, it gets pricey with the amount of context you need and the default GPT4 chatbot is decent with code. The GPT API is best hit with questions that don't have a lot of setup, can leverage its excellent general knowledge, and can be answered succinctly.
  - infecto 3y ago
    I find it pretty viable for myself. I use this kind of setup within the IDE using API keys. I will flip between 3.5 and 4. The cost of 4 is minimal compared to my time.
haswell 3y ago
This sounds like a great idea and relevant to my current goals. I haven’t used LibreChat; how are you handling authentication?
- consumer451 3y ago
  I just let them sign up with an email and password, then I turned off the ability to sign up once everyone had done that. LibreChat does support other options [0]. I configured the yaml file to use my own OpenAI API key for all users. [0] https://docs.librechat.ai/install/configuration/user_auth_system.html https://docs.librechat.ai/install/configuration/user_auth_sy... edit: oh, the only other configuration change that I made was to set the default OpenAI model to gpt-4-0125-preview.
  - haswell 3y ago
    Got it, thanks! I’ve been wanting to do some API work anyway, and this seems like a great way to consolidate everything.

infecto 3y ago

I actually think this is the way. ChatGPT honestly is not that great. I would be happy to pay per token for ChatGPT and be able to have a little more control over the system messages.

CuriouslyC 3y ago
If you regularly use GPT4 for coding this isn't so viable, it gets pricey with the amount of context you need and the default GPT4 chatbot is decent with code. The GPT API is best hit with questions that don't have a lot of setup, can leverage its excellent general knowledge, and can be answered succinctly.
- infecto 3y ago
  I find it pretty viable for myself. I use this kind of setup within the IDE using API keys. I will flip between 3.5 and 4. The cost of 4 is minimal compared to my time.

haswell 3y ago

This sounds like a great idea and relevant to my current goals. I haven’t used LibreChat; how are you handling authentication?

consumer451 3y ago
I just let them sign up with an email and password, then I turned off the ability to sign up once everyone had done that. LibreChat does support other options [0]. I configured the yaml file to use my own OpenAI API key for all users. [0] https://docs.librechat.ai/install/configuration/user_auth_system.html https://docs.librechat.ai/install/configuration/user_auth_sy... edit: oh, the only other configuration change that I made was to set the default OpenAI model to gpt-4-0125-preview.
- haswell 3y ago
  Got it, thanks! I’ve been wanting to do some API work anyway, and this seems like a great way to consolidate everything.