3 ms·

LiteLLM is basically Bifrost in the Python ecosystem.

• gcgbarbosa 20d ago
  Yeah, but bifrost seems tighter and claims to use way fewer resources
  • yujonglee 20d ago
    hey - litellm will migrate its core to Rust soon. please follow this issue if you're interested! https://github.com/BerriAI/litellm/issues/31263 https://github.com/BerriAI/litellm/issues/31263
  • yujonglee 20d ago
    also if you had resource issues with your production deployment, keen to hear more details
    • testycool 20d ago
      I don't have specifics since it's been months, but LiteLLM on a hetzner server, deployed through Coolify was using 1-4 GB (cannot exactly, and dont know why either). Bifrost feels very light, though. Will try LiteLLM if it's in Rust. Would also appreciate a slicker aesthetic. I got used to Bifrost shadcn with 0 border radius.
      • yujonglee 20d ago
        - We recently migrated to shadcn, which also comes with dark mode support. - You can subscribe to the issue or email me at yujong at berri.ai I’m happy to provide any support if you’re willing to try out the initial version.
    • deleted 20d ago
      [deleted]