4 ms·

What sucked about FastAPI?

• behnamoh 3y ago
  Not fast enough! I used it to call llama.cpp server but it would crash if requests were "too fast". Calling the llama.cpp server directly solved the issue.
  • dekhn 3y ago
    Honestly, that doesn't sound right. I'm curious what you mean by crash thoguh.
  • ralphist 3y ago
    Did you get "connection reset by peer" when you sent a bit too many requests perchance? I've never found the source of that in my programs. There's no server logging about it, connections are just rejected. None of the docs talk about this.
    • behnamoh 3y ago
      I don't remember the exact error name but the FastAPI server would just freeze.
      • dekhn 3y ago
        a freeze is not a crash.
  • dumdedum 3y ago
    This sounds like a layer 8 problem
  • KaiserPro 3y ago
    Interesting, I've used fastAPI to serve many thousands of requests a second (per process) for a production system. How were you buffering the requests?
  • jononor 3y ago
    You ran FastAPI app proper server like Uvicorn?