3 ms·
This ended up impacting quite a few users; the response is streamed from a Vercel function where I had not changed the default timeout, so at 10 seconds it was
by jasonthorsness 2y ago
This ended up impacting quite a few users; the response is streamed from a Vercel function where I had not changed the default timeout, so at 10 seconds it was just cutting things off where it was. Some invocations of the DeepSeek API take much longer than others. This should be fixed now with a longer timeout.
- jasonthorsness 2y agoAPI keeps going through periods of 1-2 minutes of everything timing out... then works well for ~5-10 minutes. Might be better to host this model yourself for serious use right now.
- jasonthorsness 2y agohttps://status.deepseek.com/ https://status.deepseek.com/ flakiness today but it looks like pretty good history