4 ms·
I have a tangential question. I remember distributed processing being a "next big thing" back in the day. The idea was that a company could run complex operatio
by Breza 4y ago
I have a tangential question. I remember distributed processing being a "next big thing" back in the day. The idea was that a company could run complex operations by borrowing some power from all their employee's computers. Seti@home proved the concept was possible. So what happened? Why can't I train a random forest across all the computers currently logged into my company's VPN?
- ikiris 4y agoidle states, and the scam of cryptocurrency happened.
- nonagono 4y agoIt's just not worth it. Writing programs in a distributed fashion is hard, setting up compute servers on employee machines is awkward, and few companies actually need to run large compute jobs. So while it's in theory possible, the non-compute costs of doing this would eat up any compute savings.
- adgjlsfhk1 4y agobecause it's probably easier to write the code to run on a single 256 core server with 8tb of RAM.
- lacker 4y agoNowadays a modern radio telescope, let's take MeerKAT in South Africa, can produce maybe 10T of data per minute. The total bandwidth out of the site is orders of magnitude less, because it's in the middle of nowhere in the desert. Same thing for pretty much all the radio telescopes - the technology improves over time, and we capture orders of magnitude more data, but the internet connections to these remote locations stay very slow. So we have to do most of the processing on site. AI training is similar but not quite so extreme - when you try to use a bunch of consumer machines, bandwidth becomes the limiting factor.
- acjacobson 4y agoIf bandwidth wasn't a limiting factor would it be worth it or still make sense to use big machines onsite?
- lacker 4y agoIf bandwidth wasn't a factor, the first rearchitecture that I think would make sense is to do most of the processing in a single datacenter somewhere. Having one datacenter in West Virginia, one in South Africa, one in New Mexico, one in the California mountains, it introduces a lot of overhead. The systems naturally drift their configurations over time, and nothing is quite as "write once run everywhere" as you'd like.
- saagarjha 4y agoThe employee computers got put on the cloud, which let them be shared.