3 ms·
> We use high core-count CPUs, 2TB RAM, and 2x 100Gbps per server. On average, our servers have about 16x 15TB drives. > So let’s say we run our 850 servers I
by bluedino 4y ago
> We use high core-count CPUs, 2TB RAM, and 2x 100Gbps per server. On average, our servers have about 16x 15TB drives.
> So let’s say we run our 850 servers
I'm not familiar with this company, but it says on their website We’ve been crawling the web for over 10 years, collecting and processing petabytes of data every day., they have their own search engine (named 'Yep), provide all kinds of reports, etc.
I'm guessing they are running huge Hadoop clusters or something? One of those workloads that just isn't suited for the cloud, and they're just taking the advice of Joel Spolsky
“If it's a core business function — do it yourself, no matter what.”
- debarshri 4y agoI'm familiar with the product. They help you optimize your SEO, provider serp scores, backlink health, organic keywords performance etc. Basically, everything to do with Google SEO. I think calling them "just a bunch of hadoop cluster" might be disservice to the amount of effort that goes into building a product like this esp. When millions of digital marketing professionals use their service.
- KyeRussell 4y agoI feel like you’ve used a dishonest interpretation of this comment to push back against it and flex that you know what this company does? The only person ther said “just” is you. And “large Hadoop clusters” can be the most resource-intensive component of their infrastructure, but not necessarily the company’s value-add, or where most of their effort goes. Stop being adversarial.