3 ms·
>orchestrating an inference cluster, autoscaling, prediction monitoring, Does this approach preclude the need for queuing (a la RabbitMQ) and/or a load balance
by bobosha 7y ago
>orchestrating an inference cluster, autoscaling, prediction monitoring,
Does this approach preclude the need for queuing (a la RabbitMQ) and/or a load balancer?
- calebkaiser 7y agoYep! Cortex deploys load balancers on AWS and manages queueing.
- bobosha 7y agoThis is super-exciting! I didn't know it could be this easy! How do you handle API authentication? Is there a module that interfaces with AWS API gateway? or external API authentication?
- calebkaiser 7y agoRight now, users handle API auth by using AWS API gateway in front of Cortex, but incorporating AWS API Gateway into Cortex to automate this is on our short term roadmap.