7 ms·
I've been telling developers for years if you build your infrastructure on top of tons of 3rd party services like Google Cloud or AWS then you basically don't o
by WClayFerguson 6y ago
I've been telling developers for years if you build your infrastructure on top of tons of 3rd party services like Google Cloud or AWS then you basically don't own it, and can be shut down any day, against your will.
Web companies should build on "Linux" only, as their base platform, so they own everything above that. I was a fan of Parler but building on AWS was a huge mistake, and they should have realized they were "owned" from day one.
And to any other CEO/CTO making the same mistake: "Beware, you do not have control over your company."
- aabhay 6y agoIt is increasingly, vanishingly hard to not use the big three cloud services. Mainly because any platform or tool you might use is _also_ hosted on these clouds.
- WClayFerguson 6y agoYou can build on Java + SpringBoot + MySQL + Linux + Docker Compose, then what else do you really need? I mean there's tons of technology stacks to choose from, but people get lazy and take the easy way out rather than learning to scale servers themselves. Get on Linode. It's base on Linux instances. If you build on Linux you are "free" and not "owned"
- onion2k 6y ago... what else do you really need? A proper database. :)
- WClayFerguson 6y agoThere's a lot of DBs to choose from: MongoDB, MySQL, PostgreSQL. What you want to avoid is anything from Amazon or Google ANY other similar service.
- swebs 6y agoIs that supposed to be a dig against MySQL, or did you just miss that in the list?
- WClayFerguson 6y agoLooks like you misspelled "NoSQL" :)
- runawaybottle 6y agoLinode and Digital Ocean docs also are leagues ahead of AWS. They cover a lot of stuff. I didn’t even know what fail2ban was when one of my VPS’s got hacked. Went through all their docs, they cover a lot and really helped me understand how much I didn’t know while at the same time providing guides on getting up to speed. AWS won’t tell you about those things because they sell you security, so you remain a dumbass about those things indefinitely.
- WClayFerguson 6y agoExactly right. lol.
- deleted 6y ago[deleted]
- indigodaddy 6y agoIf you are doing ssh config properly, then you don’t need fail2ban or its ilk.
- Mediterraneo10 6y agoFail2ban protects more services running on a server than just SSH.
- cptskippy 6y agoMost everything I develop is in .NET and will run comfortably in Nginx, IIS, or an Azure App Service Resource. It's not that hard. In my experience most developers just inherit the infrastructure and even the base project from someone else. They've never stood up a server or configure anything from scratch so they have no idea what they're doing.
- DarkWiiPlayer 6y agoI've been telling people for ages that, even if they want to use a pre-built solution, they should at least set up the base systems a few times to get a better felling for them and.
- cblconfederate 6y agothat logic is a vicious cycle
- gameswithgo 6y agoaccording to parler they did what you suggest
- WClayFerguson 6y agoParler used AWS. I suggested avoid AWS. What am I missing. I might be missing something.
- margaretdouglas 6y agoAWS is a suite of services. One of those is EC2, which is just virtual servers hosted by Amazon/AWS. A virtual server is no different than a physical server from the perspective of the guest operating system, regardless of if it is Linux or not. Linux is just the software running on the server, it has nothing to do with ownership. The only way "running on AWS" is problematic is if you tied yourself to their non-generic services like ECS or Beanstalk. tl/dr: building on AWS and building on Linux are not mutually exclusive. One represents hardware the other software.
- WClayFerguson 6y agoWe used AWS and EC2 at my last job so I've done about 4 years worth of what you're describing. Definitely if you use Amazon as your way of getting a Linux instance that's fine, because then you can just move to Linode or any other hosting service because Linux is the one thing they all support. When I say don't use "AWS" I should've been more clear I'm talking about their proprietary stuff. Basically you should be able to run on a plain Linux as your base.
- indigodaddy 6y agoParler didn’t use any proprietary AWS services.
- WClayFerguson 6y agoThe Parler CEO initially said they would be offline for a whole week, in order to “rebuild from scratch”.
- bitcoinmoney 6y agoWhy can’t they just backup regularly and redeploy somewhere? Isn’t it as easy as backing up a DB and restoring?
- jpollock 6y agoWhen you build on top of "linux", yes. However, many cloud services are built on top of S3 or App Engine or other proprietary services. This means that they can only be run on that provider. They can be faster to develop, at the risk of not being able to move later.
- manquer 6y agoS3 is not that hard to replace. There are plenty of services like backblaze which provide S3 Api. You can spin up your own service with something like minio. Getting S3 reliability or availablity is lot harder ofcourse, but most apps don't need that.
- ashtonkem 6y agoIf you restrict yourself to only the set of AWS functionality that is common to all hosting providers, you can do that. But not only is that very hard to do, it basically negates the premise of AWS in general. There are also lots of areas that you can’t do this, such as IAM and network rules, so you have to build an abstraction on top of it that’ll work with open source tools on a separate host.
- PaulDavisThe1st 6y agoPremise of AWS for me: reasonably priced (not cheap!) linux VM, close to the backbone, essentially total control of the VM, easy provisioning of new disk storage when required (i.e. EC2 with a smidgeon of EBS) The rest of it? I think I understand why some systems need/want it, but no thanks.
- ashtonkem 6y agoDepends on what you’re doing. At the scale $EMPLOYER works at, AWS built in services are key. Things like DynamoDB global tables are extremely hard to run on your own, and things similar to AuroraDB and Kinesis can be run on your own but they take up a lot of personnel hours better spent focusing on product. We could probably eliminate those services and self-run, but it would be an extremely unwise usage of company time and money. But we also run services in multiple continents with the need to handle clients doing silly things like getting into airplanes and flying into another continent. Your situation might not benefit as much from AWS specific services, so YMMV.
- jcriddle4 6y agoIt isn't just getting kicked off the platform that you should worry about. You have zero control of long term pricing. Developers sometimes even develop without doing any math on what the services they are using cost in year one. Ask people how often they have already had to go back and rework code and shutdown servers because the bills coming in were out of control. The myth that you can just migrate if costs go crazy is completely nuts.
- jcun4128 6y agoInitially when I saw the EC2 micro prices I was like "wow that's a fraction of a cent" but then you multiply it 750 times in a month like oh...
- nathias 6y agoLinux doesn't help here. You can have your own servers, but then ISP can shut you down and Mastercard and Visa will ban you from the online economy at will ...
- lapphi 6y agoIf Silk Road (and its spawn) manage to stay online until the government shuts them down then these more-legal companies can surely find a way.
- nathias 6y agoSure if your users can use crypto and tor you can stay open for a few years... but that isn't the same problem.
- WClayFerguson 6y agoLinux is much better than relying on proprietary services. Nobody said Linux solves all the other problems in the world. lol.
- nathias 6y agoI don't know what do you mean really, what do you think Amazon uses for their clouds, Windows 95?
- deleted 6y ago[deleted]