paladin314159

16 ms·

121.
by paladin314159 11y ago
Had a little bet with a coworker as to whether this was possible... would love to see better solutions! Rules were: implement the game logic only (start with a 4x4 board, given an input direction, update the board) in ten lines of python, w
122.
Show HN: 2048 in ten 60-width lines of python(gist.github.com)
2 points by paladin314159 11y ago|1 comments
123.
AtlasDB: Allow any key value store with durable writes to have transactions(github.com)
25 points by paladin314159 11y ago|1 comments
124.
by paladin314159 11y ago
That's a great observation. Somewhere along the spectrum of query flexibility you reach a point where pre-aggregation doesn't work anymore. We have a separate column-store based system in place for certain types of queries which w
125.
by paladin314159 11y ago
Thanks! We have considered using HLL, and it's a pretty cool algorithm. For us, however, it's important to get the set members at the end of the day. Amplitude is unique from other analytics products in that we put a lot of emphas
126.
by paladin314159 11y ago
The raw data is stored directly into S3 every hour, but there are multiple systems that process the data directly from Kafka in order to produce the real-time pre-aggregated views.
127.
by paladin314159 11y ago
The files in S3 are pre-aggregated results keyed by how we fetch them (e.g. there will be a file containing all of the users active on a particular day). What you've described is a pretty accurate description of what happens :)
128.
by paladin314159 11y ago
We don't use Camus; IIRC, it didn't exist at the time that we built most of the infrastructure. We just read data directly out of Kafka using client libraries.
129.
by paladin314159 11y ago
Most of our databases are multi-tenant, so a single cluster will handle all customer data. The exception is Redshift, which has a separate cluster for each customer since we allow them to have direct access to it ( https://amplitu
130.
by paladin314159 11y ago
We tried a variety of PostgreSQL-based approaches, including this one. Unfortunately, the way you do set insertions using arrays is to do a O(n) membership check, which means your set will take O(n^2) to construct -- very inefficient.
131.
by paladin314159 11y ago
Redis is a great piece of software, and we leverage it for several uses cases outside of managing sets. For our use case, there were a couple of blockers that prevented Redis from being a viable solution: 1. It's tricky to scale out a
132.
by paladin314159 11y ago
To be totally honest, there are so many technologies out there that claim to solve analytics that it's tough to seriously consider all of them. That said, we have looked at Druid, which is also a good example of using lambda architectu
133.
by paladin314159 11y ago
Author of the post here. Happy to talk about how we've designed/built our architecture at Amplitude!
134.
by paladin314159 11y ago
Thanks for bringing this up! As CanioX mentioned, it'll be easiest for us to figure out what's going on with your numbers if you contact us directly at support@amplitude.com. Please don't hesitate to reach out to us regarding
135.
by paladin314159 11y ago
Engineer at Amplitude here. Thanks for your thoughts! We've been thinking a lot about this exact issue over the last few years and have come to the same conclusion: when dealing with a platform that provides a ton of value out of the b
136.
by paladin314159 11y ago
Amplitude Analytics - San Francisco, CA We're hiring backend, frontend, devops, mobile, and test engineers who are looking to work at an exciting early stage startup (20 people) that has grown very quickly over the last 6 months and is
137.
by paladin314159 12y ago
Compared to the lock-in of the AWS ecosystem in general, Redshift honestly isn't that bad. You can unload all of your data into S3 and then do whatever you want with it. I'd be surprised if most data warehousing solutions had such
138.
by paladin314159 12y ago
Amplitude Analytics - San Francisco, CA We're hiring backend, frontend, devops, mobile, and test engineers who are looking to work at an exciting early stage startup (11 people) that has grown very quickly over the last 6 months and is
139.
by paladin314159 12y ago
This is really cool. I took a (very) basic class on modern physics with Susskind; awesome guy and great at explaining things. Will have to read through this!