4 ms·
For ETL; Jenkins for orchestration, EMR + Pig + Hive for processing. Warehousing; S3, Parquet and ORC. AWS Athena for analytical queries over S3. Kinesis for
by usgroup 9y ago
For ETL; Jenkins for orchestration, EMR + Pig + Hive for processing.
Warehousing; S3, Parquet and ORC.
AWS Athena for analytical queries over S3.
Kinesis for stream buffering; also processed by EMR.
Everything except for Jenkins is pay-per-use. No idle components.
Very effective and cheap.