justinsb

67 ms·

571.
by justinsb 14y ago
Are recommendations computed in real-time though? Have you considered e.g. batch recomputation overnight with a 'full' algorithm, and just applying a linearized model to any newly rated content? I feel like the quality of the Netflix recom
572.
by justinsb 14y ago
Something constructive I'd like to hear from Netflix is a bit about what it is all those cloud instances actually do :-) My understanding: Streaming is offloaded to a CDN. The content & user databases change very slowly and thus are ve
573.
Lessons Netflix Learned from the AWS Storm(techblog.netflix.com)
115 points by justinsb 14y ago|49 comments
574.
by justinsb 14y ago
Interesting link - thanks. I think Netflix are expecting another cloud to offer the same model and API as Amazon though, which isn't likely to happen - everyone else is learning from AWS's mistakes! Even if it did, many of the features they
575.
by justinsb 14y ago
Plainly they're not immune to _all_ failures; I think you've made a parsing error there. http://techblog.netflix.com/2011/04/lessons-netflix-learned-... http://www.zdnet.co.uk/news/cloud/2012/03/18/netflix-how-we-... http://perfcap.blo
576.
by justinsb 14y ago
Love this Twitter account - hope it lasts!
577.
by justinsb 14y ago
You're joking, but I bet Netflix's Asgard system gets support for OpenStack pretty quickly now...
578.
by justinsb 14y ago
When some AWS AZs went down last year, Netflix made a big deal of their distributed architecture and how that made them immune to failures of an entire AWS region. That now looks more like blind luck.
579.
by justinsb 14y ago
Interesting - and your 9 DIMM argument makes sense. The large is exactly 7.5 * 2^30. The small is about 1.66 on the same scale, which isn't outrageous to round to 1.7. I guess I'll check the state of play on e.g. the 68.4 GB machine, which
580.
by justinsb 14y ago
Well, I think that's still controversial, but it sells hard drives. For RAM, I still buy a 16GB DIMM; if I buy it from Amazon I expect it to show up as 16GB, not 14.9GB. With EC2, that's not the case. But the point is that I trust Google,
581.
by justinsb 14y ago
Perhaps Google doesn't want to define their offering in price terms, but in terms of power. Their demo focused on accelerating computations that could lead to a cure for cancer. I think pricing is just one of the dimensions on which AWS wi
582.
by justinsb 14y ago
Google said 50% better price/performance, and I believe Google's culture is less tolerant of marketing "exaggerations" than is Amazon's. As a simple, concrete, example: Amazon's GBs are 10^9 bytes; Google and the rest of the world defines t
583.
by justinsb 14y ago
At first glance, Google offers much more powerful machines at a given price point vs AWS. Amazon offers lower price points, but the machines are really limited. I think AppEngine is the competitor for the super-low price points. Free &#60
584.
by justinsb 14y ago
I believe there was a decision that each Google product should be priced at least at cost. So, products that were under-priced had to raise their prices. I'm more comfortable knowing that these products aren't loss leaders. That said, it
585.
by justinsb 14y ago
The first step you've linked there for PhoneGap Android is to install Eclipse. The first step for PhoneGap iOS is to install XCode (=> OS X). The first step for PhoneGap Windows Mobile is to install Visual Studio Express (=> Windo
586.
by justinsb 14y ago
I think this blog post is a great starting point and exactly what a platform evaluation should be: an "app" that combines HTML Boilerplate, Zepto.js & Twitter Bootstrap to build something that includes some useful user interaction. And
587.
by justinsb 14y ago
I really like the approach of bringing up a second set of systems during an upgrade, so rollback is easy: makes the most of virtual machines. I'll have to add that to PlatformLayer! Asgard looks to be very heavily tied to AWS though, which
588.
by justinsb 14y ago
And they probably should have launched GMail before Hotmail, Search before Altavista, and Adwords before Overture ;-)
589.
by justinsb 14y ago
No need to mess with the encoding format - just use an existing utility (or library) to grab the raw frame data. e.g. ffmpeg
590.
by justinsb 14y ago
I made the same decision on my personal blog. When there are comments both on a blog and here on HN, the conversation feels unnaturally fragmented to me. Further, when I did have both, comments that self-selected the blog (vs HN) are - in
591.
by justinsb 14y ago
While I do agree that a good database can replace memcache in certain circumstances, isn't a 24ms response time from memcache a pretty good indication that something is seriously wrong there? I'd expect <1ms, if your network allows you
592.
by justinsb 14y ago
The article (and much of the case so far) is talking about copyright, not patents. There was no need for an amendment, because patents & copyrights are in the constitution itself: http://en.wikipedia.org/wiki/Copyright_Clause
593.
by justinsb 15y ago
I doubt GWT is dead, as some major Google properties are built using it, including AdWords. That said, I really wish Google would work a bit more on polishing GWT. It's an amazing technology, but the documentation is woeful (the official d
594.
by justinsb 15y ago
Looks like I need to post my blog post about how to set up Swift really easily!
595.
by justinsb 15y ago
I'd recommend installing OpenStack's Swift component (S3 equivalent) and evaluating that as well. You can run it on one node for development purposes, you can scale it up if you want private object storage on your network, and many public
596.
by justinsb 15y ago
Do you have a source? I'm interested in knowing what "best one" means. If it means "cheapest for Netflix", it wouldn't surprise me if this all combines to mean that Netflix have moved the bulk of their traffic to Level 3, who don't pay an
597.
by justinsb 15y ago
The voxel article says it, but the GigaOM article it links to spells it out: "Akamai and Limelight pay Comcast to deliver their traffic to their end users. Level 3, on the other hand, is paid by Comcast, ostensibly for transit, but now, see
598.
by justinsb 15y ago
It seems that Netflix stopped using Akamai. The other discussion thread here has some great links: http://news.ycombinator.com/item?id=3845098
599.
by justinsb 15y ago
That's a great link, though a little confusing to me. Here's what I understand, with fake dollar amounts: CDN services need to be priced at $2. Netflix used to use Akamai; Netflix paid Akamai $3, Akamai paid Comcast $1, and everyone was ha
600.
by justinsb 15y ago
On the wireless point, I believe that the expensive bit of wireless networks is definitely the spectrum from the tower to the device. So I don't think the analogy holds. (?)

More ›