3 ms·

"It works. That's annoying." Indeed! Would be cooler if support for local llms was added. Currently only has support for anthropic and openai. https://github

• mikebelanger 1y ago
  Yeah that'd be really something. If you could just pay the cost up-front, rather than worry about how much every newer request cost, that really changes the game. There's still many other issues to worry about, like security. But as the author points out, we might be much closer than we think.