3 ms·
Req.post to /chat/completions, streaming the tokens through a parser and doing regular elixir messages. It's really not more complicated than that :)
by chrismccord 1y ago
Req.post to /chat/completions, streaming the tokens through a parser and doing regular elixir messages. It's really not more complicated than that :)
- throwawaymaths 1y agoeven less complicated, just set stream: false in your json :)