3 ms·
I don’t think anybody should go “fully FaaS”, it’s like saying screwdrivers are useless, all you need is a hammer. That being said, Cloudflare is on the path t
by gen220 3y ago
I don’t think anybody should go “fully FaaS”, it’s like saying screwdrivers are useless, all you need is a hammer.
That being said, Cloudflare is on the path to offering a great GPU FaaS system for inference.
I believe it’s still in beta, but it’s the most promising option at the moment.
- breckenedge 3y agoRight, I still find it faster to manually provision a specific instance type, install PyTorch on it, and deploy a little flask app for an inference server.