6 ms·

Wait... so you're tell me FastAPI is slow...

• ssheng 4y ago
  FastAPI is great building block but can't expect it to work for model serving out of box.
  • beckingz 4y ago
    Load your pickle file and it works?
    • beckingz 4y ago
      I know, pickle is insecure, etc
      • chaoyu_ 4y ago
        Most team don't really concern about the security side of things when using pickle for model deployment, more about performance and resource utilization. It works ok for very light weight models, but doesn't scale.
• jeremycarter 4y ago
  Actually it's very slow. Wait until you have 50 concurrent customers hitting it.
  • nemexis 4y ago
    That's weird, it is supposed to be faster than alternatives. Do you have some benchmarks to support that critique?