4 ms·
yeah, the api times out pretty regularly which is unfortunate. i use vercel which has a 10second limit
by shahahmed 3y ago
yeah, the api times out pretty regularly which is unfortunate. i use vercel which has a 10second limit
- nutlope 3y agoHey! Have you tried out Edge Streaming yet? It uses the Edge Runtime which is a fraction of the cost of serverless functions and lets you stream responses for much longer than 10 seconds, giving you the "chatting" effect that you see on ChatGPT. Docs: http://vercel.fyi/streaming http://vercel.fyi/streaming Example: https://vercel.com/blog/gpt-3-app-next-js-vercel-edge-functions https://vercel.com/blog/gpt-3-app-next-js-vercel-edge-functi...
- shahahmed 3y agoI have not! thanks for letting me know, I'll give it a try.