36 ms·
My Overkill Home Network
- whalesalad 3y agoI keep meaning to produce a post like this. My setup is not nearly as pretty though. Love to see the cannabis grow operation exhaust fan, haha. Very well done!
- f-securus 3y agoI didn’t see a filter on the exhaust fan. He is so thorough I’m sure he thought of it but I think he needs a filter to keep the fan running long term unless he is filtering the air into the room and that is good enough?
- monstermunch 3y agoNope, its ALL completely full of cat hair 24/7/365
- monstermunch 3y agoI hope you do, we need more like it!
- sillysaurusx 3y agoThank you for encouraging others. You’ve earned a loyal fan. And thanks for sharing your knowledge. Infrastructure has been an off and on hobby, but it’s hard to know how to take it to the next level. Or absurd levels (in the best possible way), in your case.
- jolux 3y agoI just bought a Ubiquiti Dream Machine SE along with a U6 Enterprise a few weeks ago and so far it’s my favorite tech purchase ever. The management interface is years if not decades ahead of everything else I’ve used before. My only complaint is that there’s no public API and thus no official Terraform providers.
- whalesalad 3y agoThe Unifi software is pretty incredible. I am not using their router though (well... an ER-4 but it does not share the same management mechanism) so I am missing out on a lot of the goodies.
- donutshop 3y agoERX here. The EdgeMax line is still rock solid and have incredible value for the price.
- whalesalad 3y agoI see absolutely no reason to jump ship, it's one of the most solid pieces of infrastructure in my network.
- syntaxing 3y agoI actually moved away from ubiquiti stuff to OPNsense + TP link AP. The firewalls rules on OPNsense makes a ton more sense and the plugins are pretty awesome.
- LeoPanthera 3y agoYou can have both, as I do. I use UniFi switches and APs controlled by a Cloud Key, but my router runs OPNsense because UniFi routers are pretty bad.
- syntaxing 3y agoYou can run a UniFi hardware controller through a plugin on OPNsense. Worked pretty well minus mongoDB conflicts with zenarmor. But I switched to omada APs because they had better range and speed.
- tw04 3y agoI would take Ruckus Unleashed over unifi all day long. Ubiquiti, unfortunately, feels like everything is constantly in beta, both hardware and software. Wait until they release a UDM SE v2 and abandon firmware on the UDM SE. The UDM in particular is a masterclass in how to upset all your customers. (coming from a previous all-in UBNT customer that had a first gen UDM Pro). Ebay Ruckus + OPNsense and my network has never been more stable and performant.
- stn8188 3y agoWow, and my wife says my network is complicated! :) In all seriousness, thanks for sharing, this is really incredible. I see a few similarities (fellow Harbor Freight shopper, ADS-B receiver)... but I took the mostly lazy way out and just use the TP Link Omada router, controller and access points. Works great for well over 50 wireless clients that we had at a recent BBQ. I particularly love your note about encrypted LoRa networks at the bottom there, I'll be interested in a follow-up on that topic. Thanks again!
- xpe 3y agoExactly. Those 50 wireless clients must be fed Internet while their 50 subjugated humans eat BBQ and prioritize device interactions over human ones. (I’m exaggerating of course! At least you are having gatherings — better than many of us!)
- monstermunch 3y agoThanks! I've been very interested in the new TP-Link stuff, they have really come a long way. I don't know if I've really ever heard of much wrong with the TP-Link stuff
- applied_heat 3y agoI have the tp-link Omada APs with controller running in docker on synology nas and am happy with it
- bazmattaz 3y agoThis is incredible. I still can’t believe some people get 1gb symmetrical in their home. In the UK I’m stuck with 70mbs down and 6mbps up. Pitiful
- PaulKeeble 3y agoShould hopefully change in the next few years, about 54% of houses have fibre to the property and the plan is over the next five years to expand that to nearly 100%. I have had 100/1000 for a while now but symmetric is still a rare product that only smaller competing fibre companies are rolling out.
- rjsw 3y agoI'm in the UK, getting 500MB symmetrical installed tomorrow, could have ordered 900MB for £2 per month more.
- tdfirth 3y agoI'm in the UK (Oxfordshire) and have a 1gb symmetrical connection at home. It's provided by Gigaclear - there's a handful of other similar operators that do fibre in more "rural" areas. It costs £79 a month, so it's not cheap to be honest, but I love it.
- jonathantf2 3y agoRing em up and tell them you’re leaving, they’ll drop you down to the new customer pricing. I’ve got the 1G up and down for something like £38 a month now?
- toast0 3y agoI had 1g symmetric in the bay area (thanks at&t) and it was nice, but am now around your speeds (85m/13m) and it's clearly worse, but not really terrible. Certainly not terrible enough to pay $50k+ install to get munifiber, even though I'd enjoy it a lot. Maybe if one of the ISPs on munifiber starts offering 10g to residences. Not that I need it, but it'd be fun.
- bashy 3y ago
- hqsolomo 3y agoNice and clean, great work! If you don't mind me asking, does your energy bill take a huge blow because of this? I had a modest homelab set up and had to start shutting things off due to how much it costs to keep it running I apologize if I missed this info in the blog!
- pm2222 3y agoPerhaps there’s solar.
- hqsolomo 3y agoThat would definitely be a big help, lol. I also imagine part of my problem is my house wiring- the previous owner had the place reno'd in '96 and clearly got the landlord special
- monstermunch 3y agoCorrect, 17kw of solar on the roof
- dheera 3y agoHaving a rack alone doesn't consume anything, it's what you put on the rack. I have a rack setup and most of the time it consumes around 200 watts during the daytime and 100 watts at night, but can spike upto 600 watts if I put a heavy CPU+GPU load on it. I also put my desktop into suspend at night, something which I think a lot more people with desktops could do. Don't run 24/7 services (e.g. Home Assistant) on your massive desktop with an i7/i9 and a GPU. Run that stuff on a NUC or Pi4 or anything that has low power consumption. Then turn your desktop on only when you're actually using it.
- hqsolomo 3y agoI get that but the blog discussed a pretty beefy setup. My whole rack still used less power than my gaming PC at load but after doing the math I ultimately saved more money by going serverless for my apps and dumping (non-critical) data into a B2 bucket on paper. In reality I just started shutting things off and only turn them on when I need them. I'm curious as to what others are doing to save costs if anything. I love the hobby but we're in a recession, lol!
- Dagger2 3y agoAll that and no mention of IPv6? At least get the basics down first.
- hqsolomo 3y agoLol I get sym 1G/1G from my ISP and a free static IP address for less than Comcrash offers for their 25/10 service in my area... The catch? _No IPv6 support whatsoever_
- systems_glitch 3y agoYeah, even with Comcast/Xfinity I run a HE.net tunnel for IPv6, just so I can have truly static allocations and not goof around with their DHCPv6 prefix request system.
- hqsolomo 3y agoDude, got any links to where I can read more? I see what you have here and I want it for me! I wasn't even aware you could use HE's services without being a customer!
- systems_glitch 3y agohttps://tunnelbroker.net/ https://tunnelbroker.net/ It's been around for a long time! If you do the IPv6 training certification, they do eventually send the t-shirt :P EDIT: They also provide free DNS for up to 50 domains at dns.he.net which is also worth looking at if you don't want to run your own for every little thing.
- lxe 3y agoI'm curious what the total cost of all this is. My reservation of rack mounted setup has been cost of hardware.
- vdfs 3y agoCost of electricity is an other factor to consider
- wredue 3y agoIt’s a black hole for your wallet. Once you start. You can’t stop. But I also now have a bunch of electrician tools for running wires, some private cameras that aren’t google or Amazon spying on everyone that walks by, and a network that isn’t bogged down by a couple people watching Netflix. And I have plans for MORE.
- KnobbleMcKnees 3y agoWhat cameras do you use?
- wredue 3y agoIt’s all ubiquiti. I use the Bullet G4 pro and doorbell g4. I’m not in any position to state anything about the competition. I am glad to have went the PoE route, even if running those wires sucked ass. I only did UI cameras cause everything else I have is ui. There wasn’t much more thought than that.
- KnobbleMcKnees 3y agoI have ubiquity APs and a USG but the camera are so expensive. I'll have to stick with my Chinese crapware and a DNS blocker for the meantime.
- megraf 3y agoAxis communications, exclusively.
- 3y ago
- s09dfhks 3y agoI'll take that Lenovo M73 Tiny off your hands ;)
- monstermunch 3y agoYou in Houston?
- tdhz77 3y agoReading this post makes me happy we are in the world of cloud providers, but realize they don’t magically work. People build them. I’m glad I don’t.
- wredue 3y agoIt’s really not all that complicated. Although I still haven’t figured out if there’s some secret way to properly creating working Ethernet cables. I get blisters on blisters on my finger tips when making lots of cables.
- bmitc 3y agoDo you use a crimper?
- monstermunch 3y agoYour time is too valuable to make ethernet cables. Either punch down to a keystone jack or patch panel, or buy patch cables Gave up on that years ago
- LouisvilleGeek 3y agoReally nice setup! the pfSense part made me smile!
- m463 3y agoas long as you're good that pfsense is not open and phones home.
- systems_glitch 3y agoPlus the domain squatting with hitler and goatse thing... :/
- hqsolomo 3y agoI'm sorry- when did they start doing this? I've been mulling making the switch to OPNSense. If pfSense is phoning home aside from the update check I might have a busy weekend ahead of me
- comprev 3y agoHave a quick search about the bad activity undertaken by pfSense against OPNSense and you'll soon change your opinion on the company.
- hqsolomo 3y agoWelp, that was... A thing they did. Reminds me of middle school antics, except these are grown folks. Guess it's time to jump ship after all!
- woleium 3y agoand that BSD still cannot do line speed gigabit on an Intel gigabit nic.
- hqsolomo 3y agoI dunno if this is entirely true- my current pfSense router gets as close to line speed as I'll ever be able to get with my setup (~900 both ways to a test server in Chicago and on LAN) and I'm running an (overkill) i5 in my generic Chinese minipc. It's possible that I don't have Intel NICs but I swear I do Got anything more I can read? Dunno if I'm just blind but I couldn't find anything on this. I'd like to learn more!
- godman_8 3y agoNice setup! I have a very similar Homelab minus the Generac (I regret not getting one before inflation kicked in, especially since I already have LNG to the home.) My only recommendation would be switching your virtualization over to Proxmox (LXC / KVM) and setting up an HA cluster with Ceph and MLAG. It's relatively easy and free and will give you a lot more features than plain ESXi and even free vSphere/vCenter.
- monstermunch 3y agoThanks! Yeah, the price on this genset I think has gone up around $4000 since I bought it, not including the install I've been meaning to try Proxmox, but my day job heavily relies on ESXi, so its nice having something to mess with at home. I am also running vSphere with an Enterprise licence, so I get all the fancy stuff
- m3kw9 3y agoI could do all that with a single ddwrt router behind my tv
- pm2222 3y agoI didn’t read in details. Why esxi is not incorporating whatever that’s on the rpis?
- greggyb 3y agoThe Pis are using GPS receivers to serve as NTP servers on the local network. The specific appear to use GPIO pins. You would not be able to wire these to the ESXI machines as readily. You typically also want time-sensitive workloads running on metal, as there are all sorts of potential complications with virtualized time. I am sure there are PCIe solutions that could easily go into a more standard form-factor machine, but perhaps these are more expensive or less readily available; this is just conjecture. The ESXi machines have minimal PCIe connectivity. Perhaps such a card could be put into one of the Supermicro chassis.
- frankreyes 3y agoGPS modules use SPI which you can get a standard USB serial adapter for $2 on eBay. As the title suggests, it's overkill. Basically it's using the Rpi as SPI adapter. Edit: USB to TTL costs like $3.5, it's like a standard RS232 serial port but much simpler and faster.
- greggyb 3y agoAh, cool. I didn't know that about the connection. Thanks for sharing.
- BenjiWiebe 3y agoIf he's using the timing pin on a GPS module, you want it on GPIO or an actual built-in serial port, because SPI or USB or other adapters can't be configured to trigger a CPU interrupt within a few CPU cycles. Your accuracy will be less otherwise.
- monstermunch 3y agoWhile you could use serial through to to a VM, I need another pin to get the PPS signal in. Not sure how to do that I also like having them bare metal
- physhster 3y ago...and I thought mine was overkill! Great job! You might however want to read about the grocer's apostrophe: https://www.grammar-monster.com/lessons/apostrophe_error_with_plurals.htm https://www.grammar-monster.com/lessons/apostrophe_error_wit...
- ojbyrne 3y agoThat page includes the sentence “A word that ends in a vowel is more likely to attracting this mistake.” I wouldn’t bring it up but… glass houses.
- monstermunch 3y agoI'll have to go over the whole post, I'm terrible at writing! Quite a few errors have been pointed out. But I can just edit them and pretend they never happened
- physhster 3y agoBasically, you don't want to pluralize acronyms with 's. The more you know :)
- thecosas 3y ago"This is also how you are probably getting to this blog, which is hosted at home." Curious to know how hitting HN impacted your setup (if at all)!
- monstermunch 3y agoNot much, because a lot of it is cached by CloudFlare Total bandwidth over the past 5 hours is 253.37 GB. But total cached and served by CloudFlare is 237.82 GB. Uncached is just 15.54 GB Here is CPU load on the VM: https://files.networkprofile.org/apps/files_sharing/publicpreview/F4nPjN9YiasxEwa?file=/&fileId=1822&x=3376&y=1734&a=true&etag=9779e139d1816bb1fb81b3c28564f305 https://files.networkprofile.org/apps/files_sharing/publicpr... Networking on the VM: https://files.networkprofile.org/apps/files_sharing/publicpreview/Pa2b246wXTL29tJ?file=/&fileId=1832&x=3376&y=1734&a=true&etag=0f9cba12030d62bd408443e3a70ebcbb https://files.networkprofile.org/apps/files_sharing/publicpr...
- deepsun 3y agoSpeedTest.net tests are useless, as ISPs give higher priority to traffic to known speed checkers. They can legally do that as we don't have Net Neutrality anymore.
- NoPicklez 3y agoI believe that's why Netflix introduced the fast.com speedtest, which runs through Netflix servers. Reducing the likelihood that the test gets shaped.
- judge2020 3y agoThe link - https://fast.com https://fast.com Cloudflare's - https://speed.cloudflare.com https://speed.cloudflare.com
- SushiHippie 3y agofast.com is the only browser based speedtest that shows the accurate results for me. The results from there resembles the download speeds I get when downloading files from different sites or installing upgrades through my package manager. Cloudflare's speedtest often performs worse for me. iperf3 - https://iperf.fr https://iperf.fr Is the most accurate CLI speed test I've found (depending on which server you choose).
- judge2020 3y agoWhat's "accurate" is going to be different for every website / destination network anyways. Unless you suspect there's some issue with the speedtest software running on the browser / target, it's showing you the accurate speed you get to Cloudflare or whatever server you're trying to pull from. If you just want to see what your ISP is limiting your bandwidth to, sure, you need to find a server that can hit that. The best speed test is to download some large linux ISOs with 100+ peers, so you max out your connection to tons of networks.
- 3y ago
- bmitc 3y agoIs there a post that covers the "why?" of all this? As someone researching maybe running some Ethernet for more stable WiFi and faster Internet access for general stuff, maybe some fiber for infotainment other purposes since it can lengthen various cables, and hooking up some security and nature cameras, I can't fathom why all of this is needed outside of it just being a hobby or running some sort of business (trading?) at home. For example, isn't $600 for redundant Internet for like the minutes the Internet is out every year worth it? Why is that level of connectivity needed?
- hqsolomo 3y agoSpeaking personally, it's just another form of tinkering. Nobody HAS to do it, much like nobody has to buy and maintain their own computer, car, home, etc... We do it because we can and it makes us happy. Extra note- I would NEVER recommend a business use their home resources for work unless you know what you're doing (and why you're doing it). Even my homelab has vulnerabilities and I'm a security professional- more moving parts = much larger attack surface. There's a reason why corporations pay big buck$ for managed security services. Most homelabs I've seen are mostly for fun and personal comfort. "What good is knowledge that is never applied" is what drives me to stuff like this. I can't speak for others but I'm sure I'm not the minority here.
- fjfuvucucuc 3y agoPretty much this. I wanted to learn about networking and server management that I no longer get to do as part of my day job.
- bmitc 3y agoGotcha. Thanks for the reply! To be clear, it wasn't a judgment but just a question to understand there weren't some unapparent reasons why. I think it makes total sense as a hobby and learning, but perhaps still overkill as the post title mentions. Haha.
- hqsolomo 3y agoI apologize if it seemed like I was irate- I'm not and your question is 100% the question we all ask ourselves before doing things like this (or for some of us, it's the first question on the wife acceptance factor audit). If anyone is running a data center in their home for a serious reason they either have small loads to justify the power consumption (rpi k8s cluster says hi), stacks to blow, regulatory pressure, or isn't factoring the costs in and is in for a rude awakening. I don't think (but also don't know) these labbers are the majority, and us homelabbers are already a rarity. If it makes you feel better, megacorps are getting out of the "self-managed data center" industry and embracing the cloud, to exemplify your very point.
- systems_glitch 3y agoVery nice setup, thanks for documenting it! I used to have a much more involved at-home network, but since moving the business out of the garage, I've moved most of the network stuff with it. Still think I'm going to have to pay pole attach fees and string my own fiber if I ever want it at the house...
- monstermunch 3y agoWe want to see you run that fiber! Do post about it if you ever do it
- systems_glitch 3y agoIf only I could find a way to get someone else to pay for it :P I tried to convince one of the local electrical co-ops to do it, and use my day-job's building (we own it) as the CO for the area. They actually sounded interested but then went radio silent. Brightspeed did basically the same thing a few months ago, but they kinda suck.
- TacticalCoder 3y ago> The generator is a 27kw Generator which powers everything in the house. This means the UPS's only need at most 10 seconds of runtime, as that's how long it takes for the generator to start and switch That Generac generator though: it powers everything but only in case there's a power outage right? P.S: there's a slight typo in TFA: it's Mellanox, not Mollonox.
- monstermunch 3y agoCorrect, only if there is an outage Thanks, I'll correct that!
- bombcar 3y agoDo you regularly switch to the generator to test it? Is that automated?
- snailtrail 3y ago[dead]
- frankreyes 3y agoI need a silent ECC server. Doesn't need to be super powerful but I'd rather have at most one fan. Any advice?
- monstermunch 3y agoDo you really need ECC? Most people don't
- bombcar 3y agoMany people got scared by the ZFS/ECC howling years ago, and didn't really think it through (because they're running without unverified backups). https://www.klennet.com/notes/2022-11-25-zfs-and-ecc-rant.aspx https://www.klennet.com/notes/2022-11-25-zfs-and-ecc-rant.as... IF you can get ECC cheap, get it, otherwise, meh.
- monstermunch 3y agoYeah, I think you and me are on the same page there. It has ECC? Great! It doesn't oh well
- hqsolomo 3y agoSome Ryzen chips (I think- might be TR) often support ECC- see if you can find a compatible mobo that supports ECC modules and Ryzen sand! When I last checked there were a few products out there
- frankreyes 3y agoI've just checked and there's some mobos for $60 with ECC. Is that for real? Supermicro costs like $1000, half that for refurbished.
- hqsolomo 3y agoWithout looking at the listing I can't earnestly say what you're seeing isn't fake but I know back when I had the same question you're asking here I saw similar offerings. Ultimately I bought a used ITX supermicro mobo+CPU combo unit from eBay for like $200
- envyac 3y agoCurious why you didn't stack them like... 1. 24p Patch Panel (Odd ports of switch) 2. 48p Switch 3. 24p Patch Panel (Even ports of switch) 4. 1u Cable Mgmt Then you could have bought 4-6" Cat 5e/6a pre-made patch cables to connect in the majority of your patch panel ports. The only cables that would traverse through the cable mgmt panel would be longer cables to the servers in your rack. I have a similar Cisco switch as your 24 port. I am not fan of how they arranged all the ports at the right side of the enclosure. Why not make the 24p one row along the top (or bottom), like the 48p with the 2nd row removed? It would be a lot easier for cable mgmt.
- greggyb 3y agoI noticed this as well. The patch panels seem only to bring some wire to the front of the rack, only to immediately send the patched wire toward the back of the rack again.
- monstermunch 3y agoThe reason its arranged like that is because it started as 1 switch and 1 patch panel, and slowly evolved, so its not ideal, but I am fairly happy with the outcome If I could re-rack it all, I might make some changes. But that means turning everything off, and I'm not sure when, if ever, I want to do that
- petesergeant 3y ago> But that means turning everything off, and I'm not sure when, if ever, I want to do that Decent robustness check
- sponaugle 3y agoGreat setup! When I put together my own home setup (see https://www.reddit.com/r/HomeDataCenter/comments/ktz6yo/my_small_homedatacenter_6_months_in/ https://www.reddit.com/r/HomeDataCenter/comments/ktz6yo/my_s... ) I had the patch panels above a collection of switches in both the MDF and IDF closet. About a year in I rearranged it to the more common interleaved switches and panels, mostly just to make it look a bit cleaner. I moved from 10g to 40g for switch interconnects in a few places, as well as used the fiber I installed to do 10g to most of the desktops, etc. Fun stuff for sure!
- rbc 3y agoMuch nicer than my setup. I have three small form factor PCs running OpenBSD tied together with a small Netgear gigabit switch. Each has an external drive for backups using rsync and dump. Copies of the backups are made to another drive for offsite storage. One computer is a workstation, the other two are servers. One server is for internal use, the other is for external services. WireGuard is used to tie the outward-facing server to an Internet hosted server so services can be passed between them. There's no UPS though. I didn't want to deal with battery maintenance... Power outages are taken when they occur. One thing about that, the computers bios are set to leave the computers off if the power blips. The whole thing sits on a single shelf of the bookcase.
- 10g1k 3y agoMy home network: Wifi router. Laptop. External hard drive, encrypted. Ready to move at any time.
- hqsolomo 3y agoSync that data to cloud-backed storage and you would literally need nothing more than an Internet connection! Granted, that means you NEED an Internet connection... But it's as close to "walking data center" as anyone can get.
- mhb 3y agoAre there any building code considerations (e.g., chimney effect for a fire) regarding a multi-floor wiring chase? Isn't this why laundry chutes are no longer permitted in some places?
- mindslight 3y agoI've also been curious about this in the context of making a dumbwaiter, but not enough to do the research. I would think having passive automatically closing fire rated doors would take care of it, but I don't know.
- bombcar 3y agoYou could look into it but I think the reason laundry chutes aren't made anymore has more to do with kids getting stuck in them and less to do with fire code (after all, stairways are chutes connecting floors).
- hqsolomo 3y agoGot stuck in a clothes a chute growing up, can confirm that those things are evil.
- bombcar 3y agoOf course there was another solution (I’m assuming you’re not still in the chute, by the way) - which is to make them so big that even a large adult male can’t get stuck. But the main reason they’re gone now is that people put the laundry on the same floor as the bedrooms in modern homes.
- monstermunch 3y agoIts a single story home, however it is from 1968, so its possible that in new code its outlawed or something
- gnopgnip 3y agoRiser or plenum rated cables are required by code if you go between floors, except in plenum rated conduit. Conduit is usually more expensive though. Non rated cable more easily catches fire and makes a lot of smoke. Plenum rated cable is about twice the price, but ethernet is pretty cheap for a single home.
- imiric 3y agoThis is inspiring. Great work! My homelab is a mess of cables, and half-baked deployments running on old Supermicro and custom servers, that is way too noisy, and probably pulls a lot of power. I wouldn't know, as I've yet to track power usage... (One of those projects I never get around to ';-D) Everything's stacked on a Lack rack, even though I have a 24U rack in a closet doing nothing. This is partly because of space and cabling constraints, but _one day_ it will all be neat and tidy, clean and efficient. One of these days...
- monstermunch 3y ago>My homelab is a mess of cables, and half-baked deployments running on old Supermicro and custom servers, that is way too noisy, and probably pulls a lot of power. I dunno man, sounds identical to mine...
- drpixie 3y agoVery impressive - but it would be terrible if they have to move house!
- monstermunch 3y agoHonestly there is a few things I would do different now, so it would be welcome to have a do-over
- bombcar 3y agoOne of the main temptations to having a house built (probably partially by me) is that I would be able to do all the wiring correctly (not just conduit in the usual places, but decorative trim in each room that easily removes to reveal the wiring cavity in the wall behind it, etc).
- WaitWaitWha 3y agoDid I miss the logical and physical diagrams? I appreciate your hobby of a well installed home network. Add the diagrams and you will increase your readers' comprehension several fold.
- monstermunch 3y agoGood idea, I'll work on some
- tristor 3y agoThis doesn't seem that overkill to me other than using fiber optics, although I've done that in the past, unless you're doing exceptionally long runs copper cabling is sufficient even at 10Gbit within a home scenario. Seems like a decent setup.
- monstermunch 3y agoMy main reason for using Fiber or DAC's is because of the power consumption. Running 10G-BaseT uses about 3x the amount of power Plus, I always think fiber is cool
- toast0 3y agoSurplus 10G switches at good prices are likely to be sfp+ and not 10g-baseT at this point in time, too. DAC for same rack is a no brainer at that point. To the rest of your house depends on what you've got in the wall and how easy it is to put new stuff, I guess. I'm running 10G-baseT between my two network cabinets, because there's no economical way to pull anything else, and there's no reason to go for more than 1g other than fun.
- tristor 3y agoTrue. That said, fiber can be painful to deal with. Electrical isolation is one big benefit, as is power savings, and of course forward-compatibility. I still prefer running copper for residential, especially because you don’t have to be as careful about bend radius and such. Within my rack I use DACs to connect all the gear, which works well since it allows maximum performance over short runs with minimal effort. Nice setup though, my comment wasn’t meant to criticize, I think having a proper network at home is a big boost to quality of life that most folks don’t realize because they’ve never experienced it.
- kuon 3y agoHere you would need a breaker after the UPS before going into the wall because UPS is not considered up to code for breaking leaking current and all outlets must have protection. That's why I ended up not having a central UPS. How is it in USA?
- monstermunch 3y agoAllowed in the USA per code NEC 400.7 But, It would have been better if I fed a small sub-panel from the UPS, and then went out from there. Shoulda-coulda-woulda!
- jancsika 3y agoLooking at this setup makes me think it would be interesting to have a public-facing chat service on a 30-second clock where the user has to pad tweet-sized messages with a pre-determined number of zeros and complete sending them off before the deadline is up: 1g lounge: must pad message with 1gig of zeros 10g lounge: must pad with 10 gigs of zeros 100g lounge: must pad with 100gigs of zeros 1t lounge: must pad with 1 terabyte of zeros 100t lounge: intelligence community meet-and-greet Edit: relevance :)
- riley_dog 3y agoThis person is pretty average over on /r/homelab.
- monstermunch 3y agoI've stopped posting there as much, when my colo post got removed for not being "in my house" i knew it was going downhill
- teddyh 3y agoIf you think a colo is a “homelab”, then maybe you’ve gone downhill.
- femto 3y agoI used to have a home network, until lightning hit nearby. It came up the power connection and the copper phone connection. The modem/router/switch fried, then it spread out though the twisted pair Ethernet and fried every interface connected to the network. These days I use WiFi unless I really need low latency / high reliability in a particular location. Optical would be nice, but WiFi is the poor man's lightning safe network.
- fastball 3y agoIs it not possible to surge protect the copper phone line?
- NavinF 3y agoIt's pretty easy, but also unnecessary when everyone uses VoIP and fiber is cheaper per ft than copper
- monstermunch 3y agoYep, first thing I did was cut the phone line and Coax off the house!
- CuriousCosmic 3y agoYeah this is why I like fiber optic cables. Lightning can't surge the modem if there's no electrical connection. And then standard power isolation and surge protection will handle all the power connections. I've yet to loose equipment to lightning from the power cables but I literally can't count the amount of equipment that has been killed by lightning striking a copper data line and then surging through my network.
- pottertheotter 3y agoAll I can get is cable internet so this worries me. What’s the best way to implement power isolation and surge protection?
- 3y ago
- willis936 3y agoLooks like every homelabber's dream. My main feedback is give those fibers a bit more breathing room. The bend radius is a little tight.
- monstermunch 3y agoAll the fiber is specced as 20/10D, so should be well within tolerance
- fastball 3y agoI don't know if it was just a lucky guess, but as soon as I saw that first pic of the house exterior with the BMW, I said "that looks like it is in Houston", and sure enough... Can someone with more knowledge comment on whether that particular design is more common in Houston or was it really just a lucky guess? I kinda feel like that carport-style design is very Houston, haven't seen it as much in other cities.
- bombcar 3y agoHouston or Southern California was my guess, because I've seen things like that there, too. But I suspect it was popular in the south as a whole for a short time, that time being when major sections of Houston were built.
- ListenLinda 3y agoI knew this wasn't an overkill network when I saw an SG300 switch in the first pic.
- monstermunch 3y agoCall be crazy, but I dig the SG switches
- megraf 3y agoI've been fascinated by home labbing for a while now, and maintain something with comical simplicity. ESXI 8.0.1 worked out of the box with the 7090 I was given. I'm migrating it from 6.7u3, which is running in 14 year old hardware (injecting the drivers was easy btw - finding the drivers was difficult). ESXi is not managed with vCenter, it's a standalone host. I'm hosting a handful of VM's that do everything I need. Critical items are never sorted solely on the server; they're stored on three remote sources, with integrity checks , and mock restorations. Fortigate 140d PoE, which handles a phone system and all of the PoE I need. Backups are simple. No RAID, again, critical stuff is not solely on the server. I use enterprise disks, and SMART - I'll get a notification with ntfy if something gets wonky. Server is consuming 60-160w. 16gb of RAM, non ECC, 5th gen i5, 12TB of storage. Homebridge, home assistant, scrypted, Asterisk, Samba, Timemachine backups (all containers configured with compose, checked into Git) windows 10 and 7 VM's All of the hardware is second hand, with exception to the disks. Ambient in the closet is 29, no dedicated cooling. UPS with cyberpower. Glad to see you're using solar, and that your hardware too is used. When I worked in the industry they'd toss stuff I could never afford... FWIW: Proxmox seemed like something new to learn entirely, ESXi seemed similar for me; I don't mind the RAID stance, or the licensing...
- cyounkins 3y agoAnyone else have experiences with Ruckus APs? I have Unifi right now. edit: RUCKUS R760 - $1800 - Wi-Fi 6E 4x4:4 RUCKUS R560 - $950 - Wi-Fi 6E 2x2:2 RUCKUS R750 - $820 - Wi-Fi 6 4x4:4 RUCKUS R650 - $520 - Wi-Fi 6 4x4:4
- VTimofeenko 3y agoTo add to my other comment: AFAIK Ruckus is not targeting consumers. They sell to managed services providers and probably even then not directly but through a reseller. The MSRP for APs in this sense is much like MSRP for rack servers - it's huge on paper but in reality the price is chipped away by volume discounts, long term agreements and licenses. Retired(yet perfectly capable) APs go through ITAD and end up on ebay/craigslist for much better prices.
- VTimofeenko 3y agoI have been running Ruckus I got off ebay for quite a while now. Flashed it into unleashed mode and it has been rock solid. In fact I am typing this comment while being about 100 ft away from the AP.
- monstermunch 3y agoBuy used off eBay 100%! Don't pay those prices Even a few year old AP will work great. My R510 is pretty old, but works flawlessly
- harry8 3y agoI couldn't find it, so many details. What's the power draw on all that? A kilowatt?
- asynchronous 3y agoWay, way too much is the answer. That amount of storage alone has got to kill his electricity bill.
- princeb 3y agohe said solar, which is pretty nice if (1) he is generating excess solar in the day (2) he cannot sell it back to the grid (3) it's not cost effective to store in batteries for night use (4) there's nothing else to spend the energy on. otherwise, i can imagine it'll still be cheaper to not run things than to run things. but it's a hobby, people spend energy and resources on more frivolous things, and those frivolous things make us human.
- iAm25626 3y agowhat no 100g or IB? Those price point have come to a point where for home lab is bearable. Well we are talking about overkill. If one want to play around with network do it virtually is a much cheaper way to go: https://www.gns3.com/ https://www.gns3.com/
- hqsolomo 3y agoInfiniband? Don't tease me with a good time JK, wife would kill me
- selectodude 3y agoI run GNS3 on a three node HA proxmox cluster :)
- efitz 3y agoYou can get an Aeotech USB Zwave stick and plug it into your Homeassistant RPi if you want to get rid of Hubitat.
- trustingtrust 3y agoBiggest problems I have faced for home networks : ISPs are poorly configured and do very shady things sometimes like DNS hijacking. More often than not poor ONU firmware or hardware means you will see weird things like latency spikes or straight up packet drops. Sometimes IPv6 won't work if the ONU is in bridge mode etc. etc. This post is overkill but what mostly works for home networks: SQM - like cake sqm in openwrt - will work wonders if don't have a great ISP. I have seen as much as 5% packet loss on one ISP who said thats acceptable for a home network. Just reduce the load until a point where packet loss is really low. Then use a DNS resolver. DNS resolver will be much more reliable like unbound for your local network as packet loss has cause really problems with DNS for me. Cheap home network equipment dns is not reliable. You could really just buy a cheap Pi and run a local resolver. It would work a lot better than your home router. You may also want to consider replacing the ONU. This is rather easier than you think. The ISP ONU are really bad. A cheap NOKIA SFP GPON is like 20$ on eBay and if you can figure out the PLOAM password and Serial and Mac and VPN ID of your ISP, you will be able to simply swap it for a more stable link. All in all I would suggest for a simple home setup: get a cheap SFP GPON and replace your ONU. Get a cheap router (either router on stick with Rpi4 for <500mbit or x86 box with SFP for hitting 1gbps with the SFP GPON) and run your own unbound resolver. Get some APs and either wire them or get a cheap mesh router 3 pack on amazon (you can get a wifi 6 3 pack for under 150$ these days on sale) and run it in AP mode.
- iptrans 3y agoObvious caveats: GPON networks are often vendor locked. This means you cannot just buy any random SFP ONU and expect it work. Even if you do get it to work, no ISP will offer you any kind of support if you do this. Some might even take to it poorly, if they find out. Generally, the best option is to ask your ISP if they offer other ONU models and choose from those.
- trustingtrust 3y agoAlmost all ISPs use Serial and (optional) PLOAM to authenticate your ONU. Nokia GPON SFPs allow you to change almost everything that is exposed to the ISP for authentication. ITU standards mean that ISPs have to work according to the spec. ISP ONUs are locked for easier management for them. They will give you 1/10th of the speed promised if it helps them deal with support calls remotely rather than visiting your place to fix it. Support calls where people complain for things like 'I forgot my wifi password' cost ISPs a lot of money. So they can basically just login to your ONU at any time remotely and change settings for you like your wifi password. They do remote firmware updates and what not remotely. This is the biggest reason why ISPs love such modem router combos. Support can be guaranteed with a phone call to fix your wifi for the average Joe. You will not get ISP support if you use your own ONU but if you are using your own ONU then you are already at that point where you know what you are doing. As far as signal issues are concerned, like I said ITU specs mean they can see the signal strength remotely. Everything else they don't have access to but you don't need them to have that access. You can always swap out the ISP provided box to troubleshoot. If you actually swap out the ONU to a better one, chances are you'll never need to call your ISP unless there is a fiber cut or some serious signal loss somewhere.
- meitham 3y agoThis is beautiful and inspirational! I am about to redo my messy homelab and have two questions: 1. I don’t see any labels attached to the cables, how do you know which-is-what? 2. I am on pfsense too but I was considering a move to OPNSense, would you explain why you choose pfsense over opnsense? Thanks
- rb666 3y agoStick to Opnsense, it is better software that is better managed with a clean historical sheet.
- ThatPlayer 3y agoWhat are the plans for the Meshastic mesh? I think having one hooked up to a server to do responses could be interesting. Or have you actually convinced other people to carry one around for messages?
- ivolimmen 3y agoI find this really disturbing. On the one hand this looks really nerdy and cool but then I see the immense amount of hardware that also relies on power... so much power. This is completely unnecessary but then I also see the pictures of an F150.. so yeah it makes sense. I have to categorize this as a (un)typical American person that does not care about the environment. Do like the fact that he runs a RIPE probe though.
- kriops 3y agoI find your comment to be at the absolute peak of sanctimony. Who are you to decide if it is necessary or not? Furthermore, why are you justified in negatively stereotyping Americans – a diverse group of individuals?
- snerbles 3y agoThe satisfaction from serving up self-righteous condemnation is one hell of a drug.
- Gibbon1 3y agoGiving attitude from 50 degrees north latitude.
- rimliu 3y agoThe question was not addressed to me, but I have some tongue-in-cheek answers: > Who are you to decide if it is necessary or not? Inhabitant of the Earth. The one affected by climate change. > Why are you justified in negatively stereotyping Americans Tell me, what is the best-selling truck in US for 46 years in a row?
- refurb 3y agoIt’s hilarious how sanctimonious moralizing has gone from things like pornography, premarital sex and smoking marijuana to now using too much energy. The people who complained about those issues thought they were “on the right side” as well. But in the end it’s all just busybodies trying to force other to live their life the way they think it should be lived.
- Fabricio20 3y agoThis is a pretty cool setup! I'm personally working on getting a backup ISP connection going this week as well (two different isps with wildly different upstreams), since poorly configured ISP network issues have been plaguing me (random packet loss out of nowhere, PPPoE issues, scenic routing to companies that have POPs on my city, etc..) and I've pretty much exhausted all ISPs in my area and they all have some manner of weird issue. So two ISPs it is! My setup currently consists of a single server with an i3-12100F, which does all of nas + hosting (9TB array for windows image backup of all local machines over smb + Home Assistant + AgentDVR) and networking (dual ISP in, single gigabit out, all handled by systemd-networkd and ip + firewall), and several 1G-CAT6 runs connected to an unmanaged switch. Wireless as several random brand APs scattered around the house, all running on low power mode and being pretty much room-confined, 5GHz everywhere, had mesh before and my experience is it just sucks! Your post made me interested in those RIPE Atlas boxes.. I might see if they are willing to send one down here for me.. with two different ISPs on different upstreams I might have some interesting data.. and maybe use that raspberry-pi I have for a stratum gps server like you did as well... and maybe a weather station too.. down the rabbit hole I go again!
- rsecora 3y agoCool but is astonishing how expensive is the connectivity in other countries. >>> Verizon Gateway sitting on top of the rack. I get pretty good signal here and get the rated speed, of around 300Mb/s down and 20Mb/s up. This costs $50/mo. There are offers [0] in the EU of 10Gbps / 25 Euros/mo. [0] https://www.digimobil.es/fibra-optica/ https://www.digimobil.es/fibra-optica/
- monstermunch 3y agoWell, its not really apples to apples, that is a 5G connection... Of course the speeds are bad and relatively expensive compared to fiber
- Thlom 3y ago>The Hubitat hub has now almost entirely been replaced by a HomeAssistant virtual machine. The only reason it is here is to connect the Z-Wave and Zigbee devices I have. However, I replace those devices with WiFi versions wherever possible There's cheap and reliable ZigBee/Z-Wave/433MHz USB dongled antennas you can replace the Hubitat with.
- mgaunard 3y agoI like how the small cupboard used to host the rack is bigger than most bedrooms in European city apartments.
- jamesbfb 3y agoI love this so much! For anyone asking why, the simple answer is: because they can! Hats off to you, Sir. I wonder if this person works in IT? I’m a dev lead, I do silly amounts of hours and when I actually have a decent amount of free free time up my sleeve, the last thing I want to do is tinker with my homelab.
- jamespo 3y agoof course he does!
- yobbo 3y agoIt seems it scratches the same itch as a model railway.
- monstermunch 3y agoYou know, I'd LOVE a model railway...
- qwerty456127 3y agoI wish every apartment would have at least some units of at least half-depth of rack space. Fitting anything (even a basic setup of a PaspberryPi + the PON modem + a minuscule switch + a PoE inhector) into the tiny space behind hatch where the cables from all the wall sockets end in my condo apartment is extremely hard. And I am still looking for a 5-port switch which would be manageable, support vlans, handle gigabit ethernet and inject PoE if possible while being really small.
- tosie 3y agoWhen powered adequately, the Ubiquiti Flex (USW-Flex) [1] might fit your needs. [1] https://eu.store.ui.com/eu/en/collections/unifi-switching-utility-indoor-outdoor https://eu.store.ui.com/eu/en/collections/unifi-switching-ut...
- qwerty456127 3y agoLooks great but I woud prefer to avoid Ubiquiti because I don't want to involve a 3-rd party cloud to manage it. But I really appreciate your suggestion, perhaps I am going stick to it as I've seen no alternative so far and my previous experience with Ubiquiti makes me confident it will do the actual job great.
- jamespo 3y agoHow about MikroTik hEX S 5 Port Router ?
- qwerty456127 3y agoThis one seems suiting my preferences perfectly. I even wonder how did I overlook it. Now I'm looking for a WiFi6 access point which would work on the passive PoE it would feed. You really helped me a lot! I wish you could feel how my mood has improved. Now I feel empowered to implement the set-up I wanted. This is a minor home improvement task but it sitted in my to-do list (after numerous attempts) for over a year.
- gchokov 3y agoMy first thought is - imagine hiring this guy to architect your corporate network. The cost would probably be 10x for hardware, for the "just in case" factor and coolness to the setup...
- Cthulhu_ 3y agoFor a corporate network I would love to have more "just in case". We had a day long wifi outage at the office once, productivity plummeted and the cost of that far outweighs the cost of buying and setting up back-up hardware.
- abwizz 3y agoit's even more economical to buy more hardware than hire somebody to maintain it properly
- justapcgamer 3y agoI am reading this during a network outage thats been going on for half of the day now. I Wish we had some of that "just in case" but the higher ups get what they paid for I suppose.
- 8fingerlouie 3y agoI used to have an overkill home network, complete with self hosting everything and 10G backbone. These days i'm more pragmatic. I have exactly 2 wired machines, and everything else runs Wifi. The network "rack" is simply a firewall and a 16 port POE switch, everything else network related has been retired to the closet. My NAS is gone. With electricity frequently going above €1/kWh last winter, it seemed like a bad idea to have a NAS sitting there, consuming ~35 kWh/month. Instead i spent about €20/month on cloud storage, and simply upload everything to the cloud (encrypted with Cryptomator), and i have redundant cloud storage (different provider) included in the cost which is where my backup goes. All that's left at home is a small ARM based machine that handles making daily backups of my cloud data locally, as well as run a small Plex library on a single USB3 external drive. Besides saving about half my previous electricity cost (as well as all the hardware cost!), i have gained SO MUCH spare time. My firewall is completely closed (save a wireguard VPN), and i no longer have to maintain anything except the normal patch routines.
- wasksrhh 3y agoI recommend you checkout Rclone (https://github.com/rclone/rclone https://github.com/rclone/rclone) instead of Cryptomater, much more robust and powerful software. I used to use Cryptomator as well, but after my data exceeded certain size, it became slow and difficult to operate. Plus, once I went to pull my data out of it, I realised that it had reset file metadata on all my files (I didn't know what picture was taken when anymore, for example)
- 8fingerlouie 3y agoI do use Rclone as well, but Cryptomator has one feature that rclone does not, it allows me to access my data "on the go" from my phone. Personally i have never experienced any of the issues you mention, but my Cryptomator vaults are also mostly below 1TB in size.
- matrss 3y agoIf you are using android there is RCX (https://github.com/x0b/rcx https://github.com/x0b/rcx) as a frontend to rclone. Rclone can also be used in termux. Not sure about apple.
- edent 3y agoCan someone explain what the multiple GPS receivers are for? I get using one for NTP. I guess a second for redundancy even though it is picking up the same satellites as the first. And the rest?
- znpy 3y agoOverkill… as the author says in the title.
- defrost 3y agoThere are 2x Internet connections + racks - one in a house closet rack, the other in the garage. Garage rack has a NAS that mirrors storage of the closet rack. Garage rack has one Raspberry Pi GPS for time services. Closet rack has two (different) Raspberry Pi GPS for time services. Looking at it that way, if you accept the 2x Internet connections each being independant and acting as cross backups in case of ??? then it's just the second GPS on the closet rack that's "extra". That can likely be written up as a home experiment in messing about with a different Pi setup. It's overkill .. but often these home setups are there to keep current on new technology and different ways of doing the same thing .. in that light it's not uncommon to have multiple ways of achieving the same end just to gain knowledge on the pros | cons of different approaches.
- NKosmatos 3y agoCome on, let's admit it fellow HNers... Most of us are jealous/envious of this network setup and would love to have the money and time needed in order to own something similar. Extra points for powering all these from solar panels and also for all the "little" gizmos (ADB, NTP, LoRa, TinyPilot, MQTT and temp/humidity/power monitoring). @monstermunch You're living the dream :-)
- wink 3y agoI'd guess a good portion of us have been at that point in our lives but has moved on and downsized or shudders at the thought of keeping that monstrosity of a rack in service or updated :P
- throwawaylinux 3y agoIt's very cool, I just don't know what I would ever do with it. And I'm not saying that means therefore I don't see why anybody else would need or want it, I would never use it though. I was thinking about running an ethernet cable or two around the house to hook up a 1gb link but I couldn't be assed in the end because wifi is good enough. It's not like I can max out my 11mb/1mb home internet. \My new laptop's wifi is a bit flaky so maybe I'll do it this year if the drivers and firmware don't come good. Cameras and weather station are nice though.
- deleted 3y ago[deleted]
- kilroy123 3y agoI'm definitely jealous. I think it's ridiculous and awesome at the same time. I imagine it uses a lot of electricity though.
- larschdk 3y agoI'm not, even though I also DIY. A multi-2.5GBe port fanless N6005 mini-PC (plus a cheap barebones WiFi AP) does it for router, switch, storage, game server (Valheim & Satisfactory), timeserver (chrony), DNS (unbound with blocklist), InfluxDB, MQTT, and it doesn't even sweat, and consumes less than 20W combined.
- 3y ago
- darkwater 3y agoWhen I worked with racks in datacenters, we usually put the network gear facing the other side of the servers, so there was no need to cross cables for the rack depth.
- dnstalk 3y agoNot allowed in datacenters that strictly enforce hot/cold aisles and your gear can't be configured to reverse air flow
- makach 3y agoThis is not a home network but a home data center. I am envious, but also glad that I don't have to deal with the maintenance of this setup.
- adr1an 3y agoTo all the comments on energy usage, check this out! this person is using solar power, https://blog.networkprofile.org/17kw-enphase-solar-install/ https://blog.networkprofile.org/17kw-enphase-solar-install/
- brandhout 3y agoYeah but the sun doesn't shine during the night.
- sponaugle 3y agoI have a similar network setup (actually a bit bigger) and a much larger computation setup. I also have a 20kw 53 panel solar setup, and a complete 42kwh battery setup. Overall power usage throughout the year for me is pretty high, on the order of 8MWh/month, and I get about 25 MWhs of total solar production. My servers and network gear take about 4kw sustained, which is 35MHws, so my solar covers about 70% of my computation and network power usage. I live the NW, so I produce most of that power in the central 5 months of the year.
- zoom6628 3y agoOk seriously jealous of the setup. Have always wanted a rack - just because. I have way too many power cords under the desk but use fused plugs and boards. Want a small cabinet just to keep cables and devices away from small curious people.
- saberience 3y agoBut why? I looked at the page but could find no understanding of what he gained from doing all this? I have a single wifi router and power everything through that and still have much faster bandwidth than the author does. It seems like a lot of energy, time, and effort (especially for maintenance) for something with minimal gains. I get 1 Gbit down and 500 mbit up and even in the worst signal rooms it only drops to 600 mbit down and 93 mbit up). Printers etc all work through wifi and backups are done to several redundant cloud services. No wires required, no expensive and energy guzzling servers needed, no patching or maintenance needed.
- orloffm 3y agoAnd now add the noise question to the equation.
- deleted 3y ago[deleted]
- snoman 3y agoStill cheaper than golfing.
- chambored 3y agoOP presumably enjoys it. There’s your why.
- monstermunch 3y ago> have a single wifi router and power everything through that and still have much faster bandwidth than the author does I'm confused, what's faster than what?
- mpsprd 3y agoThe single thing I am most envious in this setup is the little box giving symmetrical 1Gbps from the ISP. I wish fiber could grow in remote areas...
- monstermunch 3y agoI bought the house for that little box!
- tomerbd 3y agoI always get the cheapest plan from my ISP. So far all great.
- Summertimes 3y agoWhat you using for out-of-band in case something goes wrong? My favorite is ZPE Systems HSR, comes with 2 LTE modems that supports GPS and I can run some containers on it too.
- dikaio 3y agoAll I could think while reading the post is, I want one.
- 404mm 3y agoThis is some HW NSFW!! Wow! I’m in a very similar situation when it comes connections, FW and needs. I’m about to get a backup line for internet and it’s between Verizon (just like you) or Spectrum (same price, 500mbit down). What was your reason for VZW? Was ATT your only wired option?
- monstermunch 3y agoComcast is available, but it follows the same path as AT&T under the trees, so I figured that makes no sense Also, the less money I give to Comcast the better.
- 404mm 3y agoLol, I hear you on that. I’m fortunate to not have Comcast as my second option.
- tibbydudeza 3y agoOverkill indeed - got just a single router but it is so flexible (TP Link Omada) and runs various VPN tunnels without rebooting or hanging. No fancy CPU just a dual core MIPS based MediaTek 7621AT - the key difference is the software, stable and well designed and not some hacked together version of OpenWRT and some old version of Linux from some random OEM that never get's updated after release.
- jiveturkey 3y agothere's no kill like overkill! i thought this was going to be pretty meh, but indeed it was amazing. my favorite: > Raspberry Pi 3B+ NTP server with GPS/PPS time source Just one though? I have a triple LeoNTP device. Terminated my own cables to outdoor GPS antennae. Been working on designing my own but it's slow going. I also have UPS power routed elsewhere in the house. But just to 1 room, where I had a powered ISDN phone. I couldn't find an ISDN phone I liked that took power from the line, if that's even a thing. I don't remember as that's ancient history now and I don't use the remote 240v power at all, just PoE everywhere. The one thing missing is EPO (Emergency Power Off). I built my data closet into the garage, stealing part of a garage bay. It is the size of a smaller sauna room. I have an EPO on the outside, wired to the UPS. I added card access to the data closet last year, because I also added it to the outside entries of the house, and I had one controller port left over. I don't have nearly as much switching, and no fiber. But many servers. I would buy an 0xide rack if they weren't $500k.
- justinlloyd 3y agoI love looking at other people's setups, especially if they have done a clean-job on it. Currently I have four small racks: Rack #1 & Rack #2 dual side-by-side (custom built) Rack #1 NAS x1 4U NAS x2 4U Patch panel 1U Rack #2 PDU 1U UPS 4U UDM Pro 2U 24 Port switch 1U Rackmount cable modem 1U Rack #3 (it's an arcade cabinet) Workstation 4U Rackmount Mac Minis (Intel & ARM) 2U UPS 4U Rack #4 (custom built) Supermicro 4U server (330TB) that doubles as the VR computer Supermicro 4U storage box (700TB) PDU 1U UPS 2U I like tinkering, but I don't rely on my racks for anything other than compute and storage. Technically I have a partial rack in a data center that I have never physically seen, where I self-host all the usual services, but as I only rent that rack, I don't consider it "mine." Tinkering with a homelab is a useful IT skill to have, even if you don't work directly in an IT only area, but you shouldn't burden yourself with an overly complicated setup. Keep life simple (and organized).
- deleted 3y ago[deleted]
- myrandomcomment 3y agoAs someone that has build huge nation wide networks and data centers I can tell you this is far from what I want at home (now)! When I was a young network engineer I had a Sun SPARC5 running OpenBSD as a firewall. Ultra10 for my desktop. I ran my own DNS and a rack of servers. Wifi was new and of course I ran cutting edge OSS firmware on whatever was the latest HW. Too much work! Today, Ubiquity HW. Enterprise 48 PoE, 1/2.5/10G core, small PoE powered 5 port switch behind TV, etc. for fan out where needed (I did rewire house with Cat6A). 3 of the latest APs that support 6E. NVR for the cameras. TrueNAS MiniXL+ for NAS that I can run K8s on if needed (cheaper to pay IXsysten for the setup then build myself, including time). AppleTV for media. Leviton Wifi switches for remote control power/lights. 5 gig symmetric fiber internet with a Comcast backup that auto fails over (UDMP-SE for firewall). It all just works and I spend zero time on it. About the only tech head thing I still have is a stand alone 4 generation old CPU (i7) running ... gentoo targeted at that CPU for speed, as a Minecraft server. And honestly that is going to be replaced with a 2 year old SFF box soon with a less complex version of Linux :)
- leokennis 3y agoVery nice but…isn’t it like .3 FTE or something to keep this all running/updated/fixed?
- simne 3y agoCool setup. I have worked in Telecom industry before and going to build something similar from second hand devices, but then switched to dev and now mostly wires left (sold all this telecom stuff to pay expences) :)
- yDogbone 3y agoas a noob, I'm curious why avoid Ubiquity's hardware?