3 ms·
I built an Adtech platform on Lambda recently: It's processing 9 billion events per week. 1. We used Firehose which pushed the data to s3 2. Go binary on Lam
by InGodsName 8y ago
I built an Adtech platform on Lambda recently:
It's processing 9 billion events per week.
1. We used Firehose which pushed the data to s3
2. Go binary on Lambda transformed the data into Parquet format
3. Used Athena to query this data
4. Using Lambda to adjust the machine learing data based on the ariving data in batches.
5. Using Lambda to query athene/bigquery for data dashboard queries. Again using Go binary for max performance.
All this made our platform 10x cheaper.
- Jupe 8y agoYep, there are workloads that benefit from the FaaS model, but not all. In my case, the cost / hassle of high-availability, scaling, no need for state, time-based triggers, and more, made Lambda an easy decision to make: and it's working quite well. A cron-triggered job every minute is still in the "free" tier, so even better!