3 ms·
What homelab people who do not work with/in a data center daily doesn't realize is how noisy and power hungry is the equipment they procure. They got a managed
by bayindirh 3y ago
What homelab people who do not work with/in a data center daily doesn't realize is how noisy and power hungry is the equipment they procure.
They got a managed switch, nice. It has VLANs, stacking, etc. nice. How many 48 port switches you can possibly stack in a home? You got a Sun ZFS7420. Great. That's a rack with two controllers with 1TB RAM each. That thing screams. An entry level 7320 is maybe workable, but you can't do 7420 at home. Same for HPE/Dell/Netapp storage boxen.
Doing Infiniband is home is another thing I can't understand. Fiber cables are extremely expensive. Copper is range limited and thick, plus unless you do HPC, its latency and speed doesn't mean much. Go fiber Ethernet. Much more practical.
I understand the curiosity and willingness to play, but it's not that practical to play with these at home (noise, space, heat, power wise). I also buy high end consumer hardware. TP-Link has 4/8 port smart managed SOHO switches for example, they even have PoE. Power your Raspi cluster via PoE with less cables and get some respectable computing power with no noise. Neat! No?
Dell's Rack servers are generally not noisy at idle, but a 2U server under some real load is unbearable. What's funny that an Intel N95 has the same power with an i7-3770K with better SIMD support while being 4x more efficient, and that thing is not slow by any means.
- isopede 3y agoI don't think fiber cables are expensive. I ran CAT6 in my house and at the same time pulled an OS2 single-mode 30m fiber cable to my office for core switching. The 30m fiber cable was $17 on Amazon, plus two 10G-LR modules at $18 each. The equivalent CAT6 is more power hungry, has less range, the cable is the same damn price, and the 10GBase-T SFP->RJ45 transceivers are twice the price of the LR transceivers at $50 each.
- bayindirh 3y agoInfiniband uses its own cables with dedicated/integrated transceivers. It's not compatible with Ethernet and can't be swapped (unless you plan to talk plain Ethernet with your IB card, which is possible). A 5m, 200gbps cable is $1,149.00 a pop [0]. Mind you, this is neither the longest, nor the fastest cable. [0]: https://esaitech.com/products/mellanoxmfs1s00-h005v-200gbps-infiniband-qsfp56-active-optical-cable https://esaitech.com/products/mellanoxmfs1s00-h005v-200gbps-... More cables: https://esaitech.com/search?type=product&options%5Bprefix%5D=last&options%5Bunavailable_products%5D=last&q=product_type%3ACable+AND+Mellanox https://esaitech.com/search?type=product&options%5Bprefix%5D...