3 ms·

Check out algorithmia - if that works for you. Instead of looking for ML specific services, look at docker or container options. Its better if they have instan

Check out algorithmia - if that works for you. Instead of looking for ML specific services, look at docker or container options. Its better if they have instance warm ups that way you can launch the vm when necessary. Also see if you can split your solution into 2 parts. One that gathers intelligence in an offline batch mode. This data should help the second part to respond faster. This would work with some Algos only. Not so much for Deep learning Explore deep learning compression techniques to reduce size of the model. There ain't many services for one off models. It doesn't make economical sense for cloud providers.

mtoohig 6y ago
Thank you for your response. Algorithmia doesn't seem like what I was looking for but glad to know it exists in case I ever get to that level. If I understand you correctly about splitting my solution into 2 parts for batches will not fit my needs since I want responses as soon as possible. I have not heard of model compression yet, and will look further into that. But for now, it seems that I would be best to just pay up for the larger VM that can handle my needs. I didn't want to pay a greater fixed cost per month for my little fun project but I guess I have to.