4 ms·
Data ingest: AWS Lambda (JavaScript) using the Serverless Framework to Kinesis Firehose. Continuous Training: Lambdas triggering SageMaker BYO training jobs.
by orasis 7y ago
Data ingest: AWS Lambda (JavaScript) using the Serverless Framework to Kinesis Firehose.
Continuous Training: Lambdas triggering SageMaker BYO training jobs.
Continuous Model Deployment: Lambdas polling SageMaker training jobs to update SageMaker BYO endpoints.
Inference endpoint: Lambda proxying to a SageMaker endpoint.
Our BYO endpoints allow us to do batch inference without a bunch of round trips between Lambda and SageMaker.
If endpoint costs get too high, we’ll implement some caching at the lambda layer.