4 ms·
Have you seen the results when they let a trained model manage Borg? The power reductions were immediate, non-trivial, and performance stayed the same. There's
by sulam 9y ago
Have you seen the results when they let a trained model manage Borg? The power reductions were immediate, non-trivial, and performance stayed the same. There's your scheduling result for you.
Look at it this way. As the paper points out, a Hashtable is just a heuristic that works fairly well in the worst case and reasonably well in the average case. No one would argue that you couldn't hand-roll an algorithm that is better for a specific, narrowly defined data set. This paper is demonstrating that you don't have to do it by hand, you can train a model automatically without the expected caveats like: size (doesn't have to be huge), latency (the model trains very quickly) or specialized hardware (they used bog-standard CPUs, not GPUs or TPUs).
This is obviously just my opinion, but I think it's pretty big. It's not big because of the paper itself, although that's amazing in isolation (they improved on hashtables!). As I said above, it _points the way_. They have a throw-away sentence about co-optimizing data layout along with lookup and not showing those result. My guess is that beats a hashtable in every way. More importantly, if a model can beat bloom filters, b-trees, and hashtables, you'd better hold onto your socks because most algorithms are just waiting to fall. To me this paper is Deep Blue vs Kasparov. We all know what comes next.
- cinjon 9y agoLink to paper that cedes control of Borg?
- sulam 9y agoBlog post: https://deepmind.com/blog/deepmind-ai-reduces-google-data-centre-cooling-bill-40/ https://deepmind.com/blog/deepmind-ai-reduces-google-data-ce... Whitepaper: https://docs.google.com/a/google.com/viewer?url=www.google.com/about/datacenters/efficiency/internal/assets/machine-learning-applicationsfor-datacenter-optimization-finalv2.pdf https://docs.google.com/a/google.com/viewer?url=www.google.c...
- tweenagedream 9y agoSlight correction, they let an ml algorithm control the cooling system in the data center, not Borg. Borg is what schedules Google's software tasks, this was not changed during this experiment.
- chubot 9y agoIt sounds like a useful technique, but I'm saying that what you're claiming is a far cry from what the paper claims. They're describing a fruitful research direction and outlining how you might get around certain problems (evaluating models is slow, retraining on inserts, etc.) Also, predicting power usage is a different problem than scheduling. It's not "managing Borg" by any stretch of the imagination. I'm not saying that's impossible, but it's not what was claimed. Also, what did Deep Blue lead to? I'm not saying it wasn't impressive, but it didn't generalize AFAIK. You are making a huge leap and claiming that a technique that isn't even deployed generalizes. What did Watson lead to? https://www.technologyreview.com/s/607965/a-reality-check-for-ibms-ai-ambitions/ https://www.technologyreview.com/s/607965/a-reality-check-fo... https://respectfulinsolence.com/2017/09/18/ibm-watson-not-living-up-to-hype-as-a-tool-to-fight-cancer/ https://respectfulinsolence.com/2017/09/18/ibm-watson-not-li... https://www.statnews.com/2017/09/05/watson-ibm-cancer/ https://www.statnews.com/2017/09/05/watson-ibm-cancer/