3 ms·
Ironically I just did this using Go and a 32 core machine processing ~50 compressed gigs per day [1] [1] https://thinkfaster.co/2017/05/big-data-with-golang-in
by swimorsinka 9y ago
Ironically I just did this using Go and a 32 core machine processing ~50 compressed gigs per day [1]
[1] https://thinkfaster.co/2017/05/big-data-with-golang-instead-of-mapreduce/ https://thinkfaster.co/2017/05/big-data-with-golang-instead-...
- justinsaccount 9y ago> Today, we’re very happy with Redshift, and we have 5 billion rows stored in our database. 1.4 billion of our connection logs (24 fields) takes up 89G on my clickhouse VM. 5 billion records would take ~320G. Based on http://tech.marksblogg.com/benchmarks.html http://tech.marksblogg.com/benchmarks.html a 6-node ds2.8xlarge redshift cluster is about as fast as clickhouse on a single i5.