Thank you for your response. Algorithmia doesn't seem like what I was looking for but glad to know it exists in case I ever get to that level. If I understand

Thank you for your response. Algorithmia doesn't seem like what I was looking for but glad to know it exists in case I ever get to that level. If I understand you correctly about splitting my solution into 2 parts for batches will not fit my needs since I want responses as soon as possible. I have not heard of model compression yet, and will look further into that. But for now, it seems that I would be best to just pay up for the larger VM that can handle my needs. I didn't want to pay a greater fixed cost per month for my little fun project but I guess I have to.