14 ms·
An Inferno on the Head of a Pin
- xja 10y agoThe article mentions microcontrollers that use 100 milliwatts as the lower end of embedded CPUs. There are actually microcontrollers that use around 1milliwatt for very low power applications. For example the msp430. TI have a neat video of one running using power generated from grapes: https://youtu.be/nPZISRQAQpw https://youtu.be/nPZISRQAQpw
- david-given 10y agoLast time this came up someone pointed me at the new generation of ultra-low-power ARMs: http://www.atmel.com/products/microcontrollers/arm/sam-l.aspx http://www.atmel.com/products/microcontrollers/arm/sam-l.asp... 35µA/MHz, so with careful selection of peripherals you probably don't even need a whole milliamp.
- dbcurtis 10y agoYes, I play with little robots built with microcomtrollers. For some of our little boards my friends and I make we leave off the LEDs because they consume more battery than the CPU. (Of course the motor makes up for that quickly...)
- sbierwagen 10y agoDesigning microamp-level systems can be interesting. From http://www.ganssle.com/rants/leaks_and_drains.html http://www.ganssle.com/rants/leaks_and_drains.html : I put one of the boards under a microscope and looked at some of the ancillary parts. There's a 22 uF decoupling capacitor. No real surprise there. It appears to be one of those nice Kemet polymer tantalums designed for high-density SMT applications. The datasheet pegs the cap's internal leakage at 22 uA. That means the capacitor draws a thousand times more power than the dozing CPU.
- tyingq 10y agoNo issues with the article as a whole, but comparing Intel's processors solely on #cores and clock speed isn't right. The table that compares a E5-1630 with a E5-1680, for example, omits the information that the E5-1680 has twice the amount of cache space, despite only having 1.5x the number of cores.
- LeonM 10y agoWhy trying to 'accept' the thermal challenge if you can just buy an HP/Dell/whatever 1U box that already has the engineering effort done for you. Or even better, why buy a box at al, just use cloud. In the old days, I used to tinker with my machines, improve airflow, better CPU cooler, liquid cooling etc. Now I just want stuff to work, so I buy a laptop.
- Tepix 10y agoIt says so in the article: For therapeutic reasons.
- grandalf 10y agoI think when one works on software long enough, a sort of pressure starts to build up making the person long to work on hardware in any way possible. I've resorted to woodworking, DIY car repairs, and VHDL... all very therapeutic :)
- vonmoltke 10y agoThis longing is even worse when one started out one's career working in hardware.
- cookiecaper 10y agoWhy not just use cloud? Because it costs way more, and the convenience factor is rarely worth it, especially when you consider that you could just run a hypervisor yourself and get most of the same conveniences within the raw hardware limitations of your cluster.
- shiftpgdn 10y agoThat's private cloud in marketing speak. :)
- DKnoll 10y agoThe 'cloud' is still composed of physical machines which somebody is responsible for. Many of those people (as compared to the general public) read Hacker News.
- soylentcola 10y agoThe talk of older processors not needing heatsinks/fans reminded me of my first (and thankfully last) lesson on this matter back around 2001-ish. In the past I'd assembled several PCs and my less-than-rigorous setup process typically involved slotting the CPU, RAM, and other cards, then plugging it into a monitor and powering up to run through a quick POST just to make sure nothing was misaligned or improperly seated. Then I'd power off, put down some thermal paste, mount the heatsink/fan, and connect any remaining cables for drives, etc. Well, in the past, this was fine. Sure, I wouldn't want to run things without at least the crappy little Intel or AMD CPU fan but 5 or 10 seconds was no big deal. But this time I was building for a friend who had me order one of those fancy new 1GHz Athlon chips. I was psyched as well because the small markup I'd added for my time helped me afford my own fancy 1GHz CPU and new motherboard for my own PC. So I followed my usual procedure and slotted everything for the initial POST (nothing worse than getting everything connected in one of those old PC cases with IDE cables and wires everywhere just to have to unhook it all because something wasn't seated properly) and powered on. Blink. Nothing. Hmm...Did I not get the CPU seated properly? Let's pop it out and reseat it. OWW! Burned the crap out of my finger and got a blister! Uh oh. It sorta smells like the magic smoke even though I don't see any. Well, eventually I realized what had happened and learned that even a few seconds without a heatsink/fan had been enough to fry that brand new 1GHz Athlon. Thankfully I had the one I'd ordered for myself and I was able to finish the build that my friend had paid for. But it was a rather expensive (for me at the time at least) lesson in the need for proper cooling on these modern CPUs.
- sulam 10y agoThe odd thing here is that no DC I know of has the power and cooling to support a rack full of these things without surrounding them with empty space to meet the watts/sqft budget. That picture of racks full of 1U servers is basically a lie -- for more reasons than power, but power is the killer. The follow up would be "an Inferno in your Rack".
- teh_klev 10y agoI'd disagree, the fairly newish DC we're in is designed for supplying and cooling 20kW/rack. That's enough for 40 or so 1u servers burning ~450 watts.
- sulam 10y agoHmm, good to know. And to update another assumption-- my guess is that this would be a pretty expensive configuration, and you may be better off picking a lower TDP server that can still get the job done, yes? Also, do you actually have room for 40 nodes in a rack? Betwee TOR switches, storage, and miscellaneous other, it seems unlikely.
- shiftpgdn 10y agoI would think 40 nodes in a rack is realistic if your battery is located elsewhere and you use side mount PDUs. Keep in mind in many places (NYC is a great example here) that real estate space for racks is the killer and not cooling or power.
- dfox 10y agoOne thing that burned us in the past was DC that provided 20kW power per rack in power, but required you to only dissipate 5kW in heat. Needless to say we changed the DC provider in like a month after they made this clear (and they combined that with offer of some kind of "cloud provider" package which meant 15kW of both and triple the price). After few another such DC-related incidents (and mostly unbelievable: circuit breakers catching fire, 600V peak on 230V AC line, double flooring collapsing from overload and such) I'm quite relieved that I don't deal with DC procurement anymore.
- pokemon-trainer 10y ago>Is this extreme? Putting 140 TDP of CPU heat in a 1U server? Not really. Nick at Stack Overflow told me they just put two 22 core, 145W TDP Xeon 2699v4 CPUs and four 300W TDP GPUs in a single Dell C4130 1U server. I'd sure hate to be in the room when those fans spin up. I'm also a little afraid to find out what happens if you run MPrime plus full GPU load on that box. What could Stack Overflow be doing that requires such a dense GPU/CPU configuration? I didn't think a commenting site would required that level of parallel processing.
- heartbreak 10y agoHe doesn't work at StackOverflow anymore.
- teh_klev 10y agoHe was referring to Jeff's conversation with Nick Craver who does work at StackOverflow.
- burkaman 10y agoThey have some machine learning projects: https://kevinmontrose.com/2015/01/27/providence-machine-learning-at-stack-exchange/ https://kevinmontrose.com/2015/01/27/providence-machine-lear... Also, they do get a lot of comments. You can read about their setup here: http://nickcraver.com/blog/2016/02/17/stack-overflow-the-architecture-2016-edition/ http://nickcraver.com/blog/2016/02/17/stack-overflow-the-arc... http://nickcraver.com/blog/2016/03/29/stack-overflow-the-hardware-2016-edition/ http://nickcraver.com/blog/2016/03/29/stack-overflow-the-har...
- Shog9 10y agoThe GPU use is perhaps the most interesting here... Marc Gravell wrote a series of articles about it: http://blog.marcgravell.com/2016/05/how-i-found-cuda-or-rewriting-tag.html http://blog.marcgravell.com/2016/05/how-i-found-cuda-or-rewr...
- guard-of-terra 10y agoI know that several years back, they ran all their Stack Overflow from one multi-core Windows server (DB and backend and frontend). And they mocked the traditional Linux setup of multiple frontends talking to multiple DB instances with huge number of small VMs. Makes sense the server should be really massive.
- msimpson 10y agoHow do you measure TDP with a Kill-a-Watt? Energy consumption does not equate to thermal design power. Nor is TDP even a measure of peak thermal output ...
- MertsA 10y ago>Energy consumption does not equate to thermal design power. Sure it does, the energy has to go somewhere. If it's not being stored in some way or emitted as EM then heat is pretty much all that is left. If you measure voltage and current for Vcore going into the CPU then you can easily calculate the amount of heat it's generating since the CPU can't really store any appreciable amount of energy and there's basically nothing else that would allow that energy to leave the CPU.
- msimpson 10y agoYet, he is not measuring the Vcore going into the CPU. He is measuring the overall wattage consumed by the PSU at the outlet using a Kill-a-Watt. This contains a lot more draw than just the CPU, itself. That's an overwhelming lack of concern for a wealth of other variables that can amount to tens of watts. So to be more concise: Overall energy consumption of a computer does not equate to only the TDP of the CPU, itself.
- lightedman 10y ago"This contains a lot more draw than just the CPU, itself." Not really. Modern RAM uses a couple watts. Fans use at typical 2.5w each. Hard Drives only a few watts (SSD variety.) The PSU in servers tends to be fairly efficient, maybe losing 50-ish watts due to heat, and they run more efficiently at lower draws than higher draws. So using a Kill-A-Watt gives you a better idea of how much power the CPU is truly sucking down (especially when a GPU isn't installed.) This is how I catch LED lighting companies lying about their actual power usage on their lights.
- msimpson 10y agoWhen you're arguing over a 110 watt difference, 50 watts lost as heat in the PSU is not insignificant and certainly enough to skew a test.
- gigatexal 10y agoAs a hardware guy first, and a (wannabe) software guy second this post made me really happy.
- Infinitesimus 10y agoHardware guy now doing software and I was all tingly inside reading about hacks to get a happy CPU under unrealistic load. (Anyone else out there ran Prime 95 and Furmark for fun in the past?)
- gigatexal 10y agoThat's how I validate my overclocks. And then after that it's 24 hours of memtest86+
- protomyth 10y agoFor me, the Pentium 60 was the turning point for heat. The 486 was pretty easy, but those Pentiums sure put off a lot of heat. I seem to remember that the Pentium 90 was cooler.
- lightedman 10y agoI love how Intel got caught on the TDP lie. I know for a fact many Intel processors run just as hot as AMDs, despite Intel blatantly lying about it.
- ReidZB 10y agoFrom the article: > I remember cooling the early CPUs with simple heatsinks; no fan. Those days are long gone. Interestingly, for desktop machines, this is not quite correct... there is still a "fanless" movement going. My roommate has a PC that doesn't have any physical moving components: no fans, no hard drives. Fanless designs are not space-efficient, though; see this fanless CPU heatsink: https://www.quietpc.com/nof-icepipe https://www.quietpc.com/nof-icepipe which is rated for up to a 95W TDP CPU - enough to run an Intel i7-6700K, which has a TDP rating of 91W. If you're willing to build a very quiet machine instead of a silent machine, liquid cooling with very quiet fans (that eventually ramp up based on temps) is very workable, and means your machine is effectively silent (i.e. at or around ambient noise levels) 99% of the time.
- webignition 10y agoIndeed. My main desktop PC has zero moving parts and a massive heatsink and copes fine with medium- to heavy-usage software development needs.
- freestockoption 10y agoWhich PSU are you using? Do you have a graphics card?
- webignition 10y agoThe PSU is a Nofan P-400A: https://www.quietpc.com/nof-p-400a https://www.quietpc.com/nof-p-400a No graphics card, just the internal GPU of a 4th gen i7 (purchased 2013).
- 6DM 10y agoI didn't realize how massive that heat sink was until I saw the little "how to install" animation at the bottom. It basically occupies the entire case O.O
- ReidZB 10y ago
- jpfed 10y agoI can't see a table like what's in the article without poking at it some more in Excel. Anyway, as you go down the table, the increasing cores do indeed have a higher cores*GHz. If you look at dollars per core-GHz (yes, I recognize this is silly), you get a generally increasing trend as you go down the table, but the E5-1680 is $63.35 per core-GHz and the E5-2680 is only $60.59 per core-GHz.
- codinghorror 10y agoYeah that is a logical way to look at it, and better than $ per core.
- odonnellryan 10y agoThis is cool. I knew a guy who literally painted gallium onto his processors as thermal paste. He said it worked really well.
- wlesieutre 10y agoGallium-based thermal compounds are commercially available, often called "liquid metal". See "Coollaboratory Liquid Ultra" for one example. They're very effective, but must be used with extreme care because aluminum is highly soluble in liquid gallium. Aluminum is the most common material for heatsinks, and it will literally dissolve if the gallium touches it. Gallium is also electrically conductive, so if you accidentally dripped any into your processor socket I assume you're going to have a problem. If you're careful with it and make sure to get a cooler with a copper contact area, it'll cool more effectively than traditional thermal pastes. I thought about trying it, but it seemed like more hassle than it was worth.
- throwawayish 10y ago> Aluminum is the most common material for heatsinks, Aluminium is the most common material for heatsink fins. The cold plate is almost always (nickel-plated) copper.
- david-given 10y agoGallium does really weird things to aluminium. https://www.youtube.com/watch?v=JHHI2Lk79cY https://www.youtube.com/watch?v=JHHI2Lk79cY
- ohazi 10y agoThis sounds like a recipe for disaster. Aluminum doesn't last very long near Gallium: https://www.youtube.com/watch?v=4HKpMYJ-6go https://www.youtube.com/watch?v=4HKpMYJ-6go Did he apply it directly to the top of the chip die or to one of those aluminum package covers? Did he use a copper heat-sink? Is somebody's leg being pulled?
- antisthenes 10y ago
- deleted 10y ago[deleted]
- antgiant 10y agoAs a mere desktop guy. Where could I find a quality resource on safe ambient temperatures for desktop computers? I tend to assume that the magnetic HDD would be the limiter.