Xorlev

52 ms·

481.
by Xorlev 13y ago
The basic twitter system is easy enough. Now store all that data forever, run ads, collect ad stats, collect server stats, collect service stats, do authentication for API calls, etc. etc. Things add up eventually. Suddenly your 6000 tweets
482.
by Xorlev 13y ago
"Research shows our routes are up to 20% shorter" shorter than what? Which research? You're lacking a lot of copy, but the idea is pretty good. Niche, but good. I'm interested to see if people will pay for it.
483.
by Xorlev 13y ago
Twitter might have some legacy Rails hanging around, but it's a beastly Scala system these days.
484.
by Xorlev 13y ago
Just make sure they know they still need to manage data replication themselves. You plan on entire machines going dark, not just drives.
485.
by Xorlev 13y ago
Can be, but tends not to be for Kafka. We run using a CMS collector and never have pauses that are enough to care about.
486.
by Xorlev 13y ago
RDS is just hosted, managed MySQL (or Postgres, or Oracle). Don't know about Cloud SQL.
487.
by Xorlev 13y ago
Hard to avoid lock contention when it's happening in the OS.
488.
by Xorlev 13y ago
Where's their opt out?
489.
by Xorlev 13y ago
As explained, it was a stop-gap solution for data storage only, we did not have a problem with write load on SSDs. We were at the point that MongoDB sharding was just as difficult to deploy as moving to Cassandra, which better fit our goals
490.
by Xorlev 13y ago
We understand that AWS comes at a premium, however we find the opportunity cost of losing the agility we have on AWS at this stage of our organization more expensive than the delta in cost between moving on to our own hardware and AWS. Our
491.
by Xorlev 13y ago
Cassandra certainly makes it a lot easier. We've doubled our cluster with no downtime. Even adding a non-double amount of nodes can be performed without any downtime (though slightly more impact).
492.
by Xorlev 13y ago
One of the key detractors for us was the 64KB limit. "The total size of an item, including attribute names and attribute values, cannot exceed 64KB." While we don't often have values over 64KB, it's possible. We didn&#x2
493.
by Xorlev 13y ago
Reads definitely aren't cheap, not compared to the hyper-optimized write path. Cassandra reads can however be exploited to make a lot of common time-series reads extremely cheap by amortizing the cost of the read over a lot of returned
494.
by Xorlev 13y ago
I will say ElasticSearch features heavily in our infrastructure elsewhere, but for the Person API product, it's purely a primary-key lookup. My coworker wrote a bit about how the search functionality of our offering works here: http:&
495.
by Xorlev 13y ago
Author here, sorry about that. It's not supposed to display on engineering posts but something must have changed/been broken recently. We know you guys aren't interested in marketing content. Again, sorry about that and thank
496.
by Xorlev 13y ago
Hey guys, Your navbar links don't seem work on your Highrise page.
497.
by Xorlev 13y ago
An easter egg! :)
498.
by Xorlev 13y ago
I sincerely hope you never deploy a system then. Not trying to attack you, but I don't want anyone to get the wrong idea. Deploying servers is not as easy as you make it out to be. If you have the dough to hire 2-3 people to run your s
499.
by Xorlev 13y ago
How about https://www.fastmail.fm/ ?
500.
by Xorlev 13y ago
Also worth mentioning, Maven manages dependencies but it's primarily a build system. Gradle is another build system with dependency management. The initial setup of publishing an artifact is high on Maven Central, but Sonatype makes it
501.
by Xorlev 13y ago
Different use cases, Rust isn't for you it seems. The whole point of Rust is to make memory management safer.
502.
by Xorlev 13y ago
Also depends on what you consider a deal -- the lower tier hardware works for a Wordpress blog, but not necessarily for much more. For the price, a good Linode or even a dedicated server will get you more bang for the buck.
503.
by Xorlev 13y ago
Not to mention, Netflix is a flagship customer for AWS and directly results in AWS getting more business, so I'd expect the discounts to be even deeper for Netflix.
504.
by Xorlev 13y ago
Kind of what you get for attempting to speculate on a meme currency...
505.
by Xorlev 13y ago
Just goes to show, invest in some real marketing, make something really valuable to someone rather than relying on 'growth hacks' that tend to explode in your face.
506.
by Xorlev 13y ago
No bet. :)
507.
by Xorlev 13y ago
Well-reasoned. I've always found framework overhead and especially tech debt to be the largest contributors to performance issues. Especially when said frameworks have lots of ways to do things and they're not all the best way to
508.
by Xorlev 13y ago
MongoDB is easy. I'll be the first one to spit-roast MongoDB with war stories, but the biggest benefit I keep coming back to is ease of use for a developer. It's very easy to change your data model and rapidly iterate. As soon as
509.
by Xorlev 13y ago
"They have proven that SQL-based storage is faster than NOSQL databases." Too broad of a statement. 'NoSQL' is an umbrella term, and thus likely has several contenders for a raw QPS metric. The additional step of parsing
510.
by Xorlev 13y ago
Linkbait title, they handled it exceedingly well. Onus is on you to back up your data. You did not 'lose' your data, given you had backups.

More ›