3 ms·
For the inference part, you can dockerise your model and use https://banana.dev https://banana.dev for serverless GPU. They have examples on github on how to d
by Oras 2y ago
For the inference part, you can dockerise your model and use https://banana.dev https://banana.dev for serverless GPU.
They have examples on github on how to deploy and I’ve done it last year and was pretty straightforward.
- JayeshSidhwani 2y agoFollowed this link to banana.dev. It appears that the company has sunset the product: https://www.banana.dev/blog/sunset https://www.banana.dev/blog/sunset