3 ms·
It’s always frustrated me how it’s not possible to set a quota and turn off services at quota. Logistically I know this is hard for water or power, but it shou
by prepend 6y ago
It’s always frustrated me how it’s not possible to set a quota and turn off services at quota.
Logistically I know this is hard for water or power, but it should be feasible for cloud computing. But I think this is an area where it’s not in AWS’ interest to set up that kind of billing control.
- 9nGQluzmnq3M 6y agoGoogle App Engine used to do this (maybe still does?). Turns out that for most production services, having everything come to a screeching halt at the very moment your site suddenly goes viral is not desirable behavior. What you want is billing alerts, so you can be notified if usage is suddenly (say) 2x usual.
- devwastaken 6y agoYou don't set caps low enough to stop if you want that kind of traffic. You set them higher to the point you're not willing to pay and can't be affording.
- 9nGQluzmnq3M 6y agoBut with the blunt instrument of a billing quota, how do you distinguish between traffic going 100x because you're #1 on Hacker News and everybody wants to buy your product, vs somebody pwning your VMs and using them for a DDoS botnet?
- detaro 6y agoIt doesn't work for every use case, that doesn't make it worthless. I.e. if your homepage has (as here) 30TB traffic in a short time, that's not just a "frontpage of HN".
- freehunter 6y agoWhy does it have to be a blunt instrument? Why not an email saying “you’ve reached 80% of your specified quota and are about to be shut off” and if you’re #1 on HN and seeing incredible sales numbers you can just go change the quota? Or just not set a quota on your business site, but do set a quota on your personal profile page that makes you no money.
- Sebb767 6y ago> you’ve reached 80% of your specified quota and are about to be shut off Because that might be very quick. Maybe you've got a 100x sign up boost in your SaaS app and you're missing out on the profit of your live? Also, what do you want to shut down? EC2 instances, which might loose you data? Maybe no new instances, but your SaaS app needs those? Shut down all traffic? Delete your S3 files? All of those could be the possible reason for exploding cost and suddenly cutting any of those could be fatal.
- freehunter 6y agoNothing is going to be perfect but if you have those concerns you can just opt out. So many people seem to forget that you’re not being forced to use any of the options available to you. You can choose not to enable that. But right now you can’t choose the opposite. What you’re describing is called “implementation details” and they don’t negate the utility of the feature overall.
- devwastaken 6y agoGood question, that's up for for the developers, devops and sysadmins to decide. If they don't want it, then they dont. If they do, then they have to be smart with it.
- dathinab 6y ago> 100x because you're #1 on Hacker News It doesn't matter why it's goes 100x. If you have a limited budged you have a limited budged. Even if the tragic is "nice" you can't affort it.
- Turing_Machine 6y ago> What you want is billing alerts, so you can be notified if usage is suddenly (say) 2x usual. While billing alerts can help you against this kind of (semi) accidental overage, it won't do anything if the account gets pwned. The first thing the pwner is going to do is turn off the billing alerts. A hard quota that required manual reentering of the credit card number (preferably in conjunction with 2fa) would help prevent that.
- dragonwriter 6y ago> It’s always frustrated me how it’s not possible to set a quota and turn off services at quota. Which services you want to turn off or alter use of as you cross various thresholds vary, so what you probably want is a billing information services that sends alerts at configurable levels that trigger programmed actions that are more complex than a simple shutdown. It would be easy to stop all spend at a threshold, but that means your entire set of apps stops working and all retained data (which usually has an associated periodic cost) vanishes irretrievably, which might be okay for an account being used for only toy apps but is going to be a business-ending error for any serious account There's a good reason why cloud providers don't provide a simple “nuke your account at a particular spend threshold” option, and the fact that people who haven't thought things through think that they want such an option is actually a factor in not providing it. If people can't keep track of spend with alerts to know that they need to take some kind of controlled restriction of services, they are going to regret unexpectedly having their whole set of services and data nuked more than an unexpectedly large bill in most cases.
- jimnotgym 6y ago> but is going to be a business-ending error for any serious account That is simply not true for every use case. We were using it for various backup jobs, until a misconfigured one racked up a big bill. This particular job was a second backup. I have no problem at all with that failing! Now I am scared to let the various engineers and consultants that make up my team use it, because I can't afford the time to check personally what they are doing.
- prepend 6y agoInitially I tried to set up something as simple as when I got near the limit for free tier, it shut off to keep me at zero. Couldn’t do that with built in. And billing data isn’t real-time so I couldn’t even figure out a script a shut off. I would lime quotas for individual services like “only spend $100 for EC2 and shut everything off when I hit it.” My point is that I would rather have my stuff nuked than get a $1000 or $10k or $100k bill. Setting up notifications and triggers is sort of possible but 1) that requires a lot of work for something that should be built in, I think; and 2) notifications aren’t in real-time so by the time I get a notification that I’ve gone over my $100 threshold I might already be at $1000. I can compensate for this with scripts and third party services, but this would be so much easier if built in. Unix has had disk quotas for decades right? Imagine if sysadmins left it up to users to monitor and control their usage and just charged overages. It’s so much more work for the user than when the system does it, or at least offers it. My Linux host offers bandwidth quotas with similar cutoffs. I would never want an “unlimited “ quota where I got billed by the transfer and it was up to me to turn off. Some may want that, but not me.
- dathinab 6y agoIt's quite doable, but not that simple. First what do you scope it to: Data, CPU, API calls, one or multiple projects. This needs to be designed carefully. Then what do you base it one: Money or the unit used (e.g. data volumen). The later is much easier. Then how to you technical implement the trigger. With many technical solution scaled to Amazone like services it's hard to stop at an exact limit, either you do some interpolation and maybe shutdown a bit before the limit is reached or you do trigger the shutdown when the limit is reached but then slightly overshoot it. Lastly how do you do the "shutdown" on limit. But in the end all is quite doable. Just not trivial. But not super hard either.