3 ms·
> The second cost problem we discovered was about the way we were passing video frames (images) around different components. To reduce computationally expensive
by terom 3y ago
> The second cost problem we discovered was about the way we were passing video frames (images) around different components. To reduce computationally expensive video conversion jobs, we built a microservice that splits videos into frames and temporarily uploads images to an Amazon Simple Storage Service (Amazon S3) bucket. Defect detectors (where each of them also runs as a separate microservice) then download images and processed it concurrently using AWS Lambda. However, the high number of Tier-1 calls to the S3 bucket was expensive.
Taking "malloc for the Internet" [1] a bit /too/ literally there.
[1] https://aws.amazon.com/blogs/aws/eight-years-and-counting-of-cloud-computing/ https://aws.amazon.com/blogs/aws/eight-years-and-counting-of...