4 ms·
What I want is even simpler: just an API that you make requests to and receive answers back. Surprisingly hard to find, outside OpenAI that is.
by julianeon 3y ago
What I want is even simpler: just an API that you make requests to and receive answers back. Surprisingly hard to find, outside OpenAI that is.
- BoorishBears 3y agoI'm not into open source LLMs in the slightest, and yet even I've trivially found tools to do what both you and the poster above you wanted lmstudio actually does what both of you want: provides an easy GUI and serves up your model over a local endpoint that mirrors the OpenAI API. There's just too much noise in terms of the tooling for LLMs, the solution is fewer higher quality solutions, not more solutions
- ingridpan 3y agohttps://gradient.ai/ https://gradient.ai/ is doing that with llama2
- worldsayshi 3y agoLooks really promising. I wonder if the similar pricing to OpenAI means that Gradient is also(?) bleeding money even if they get a good customer base. Or are these prices sustainable over time?
- ingridpan 3y agoGood question, esp as Gradient fine-tuning is so much cheaper than Open AI's
- worldsayshi 3y agoYeah it's even cheaper. Although it looks like it's about the same in proportion to approx model size/expected quality? They haven't launched any >13B model yet, although they plan to.
- MaKey 3y agoOobabooga exposes an API.
- xanderatallah 3y agoWe’re trying to do this at https://openrouter.ai https://openrouter.ai