2 ms·
OpenAI replacement ? Some really tall claims there. What's the context length for this setup ? And any latency numbers ? If this really is what it says it is, y
by thecleaner 2y ago
OpenAI replacement ? Some really tall claims there. What's the context length for this setup ? And any latency numbers ? If this really is what it says it is, you should shout these numbers.
- salade_pissoir 2y agoAs an "OpenAI replacement," maybe it ripped off Kathleen Turner's voice instead of Scarlett Johannsen's.
- troyvit 2y agoThey have more information at the link. This is an abstraction layer that allows anybody who is using OpenAI's API to use them instead, and they can point your API requests to any other LLM. This would be good for anybody using OpenAI but who doesn't want to have to worry about being locked in.
- cchance 2y agoI mean you could click the link and see what it is lol, it's an OpenAI API layer replacement, that allows you to aim it at any llamacpp instance and gguf model