3 ms·

What’s the best open source alternative?

• jckahn 9mo ago
  Jan: https://www.jan.ai/ https://www.jan.ai/
• khimaros 9mo ago
  llama.cpp
  • atwrk 9mo ago
    To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
• PeterStuer 9mo ago
  LibreChat with vLLM? https://www.librechat.ai/docs/configuration/librechat_yaml/ai_endpoints/vllm https://www.librechat.ai/docs/configuration/librechat_yaml/a...