8 ms·
Since every 3rd message on this thread (at the time I wrote this) is about how Google underpaid for this bug, some quick basic things about vulnerability valuat
by tptacek 2y ago
Since every 3rd message on this thread (at the time I wrote this) is about how Google underpaid for this bug, some quick basic things about vulnerability valuations:
* Valuations for server-side vulnerabilities are low, because vendors don't compete for them. There is effectively no grey market for a server-side vulnerability. It is difficult for a third party to put a price on a bug that Google can kill instantaneously, that has effectively no half-life once discovered, and whose exploitation will generate reliable telemetry from the target.
* Similarly, bugs like full-chain Android/Chrome go for hundreds of thousands of dollars because Google competes with a well-established grey market; a firm can take that bug and sell it to potentially 6 different agencies at a single European country.
* Even then, bounty vs. grey market is an apples-oranges comparison. Google will pay substantially less than the grey market, because Google doesn't need a reliable exploit (just proof that one can be written) and doesn't need to pay maintenance. The rest of the market will pay a total amount that is heavily tranched and subject to risk; Google can offer a lump-sum payment which is attractive even if discounted.
* Threat actors buy vulnerabilities that fit into existing business processes. They do not, as a general rule, speculate on all the cool things they might do with some new kind of vulnerability and all the ways they might make money with it. Collecting payment information? Racking up thousands of machines for a botnet? Existing business processes. Unmasking Google accounts? Could there be a business there? Sure, maybe. Is there one already? Presumably no.
A bounty payout is not generally a referendum on how clever or exciting a bug is. Here, it kind of is, though, because $10,000 feels extraordinarily high for a server-side web bug.
For people who make their nut finding these kinds of bugs, the business strategy is to get good at finding lots of them. It's not like iOS exploit development, where you might sink months into a single reliable exploit.
This is closer to the kind of vulnerability research I've done recently in my career than a lot of other vuln work, so I'm reasonably confident. But there are people on HN who actually full-time do this kind of bounty work, and I'd be thrilled to be corrected by any of them.
- asah 2y agoAlso, Google can monitor the grey/black market and buy these exploits under false identities. For less urgent vulnerabilities (such as the YT email hack), this severely caps the bounty size.
- dan-robertson 2y agoMy guess was that people selling vulnerabilities generally know who they’re selling to. Is there a big market for people selling exploits to unknown/anonymous customers?
- swiftcoder 2y agoIt's a pretty big part of most black markets that vendors don't ask too many questions about the buyer. Do you really want to know what the FSB plans to do with your exploit?
- tptacek 2y agoPeople talk about "people selling vulnerabilities" as if there's an established pattern for selling arbitrary vulnerabilities. There is not. There's an established pattern for selling exploits for RCE vulnerabilities on a subset of popular client-side platforms. It's not an especially easy market to break into (as with consulting, people starting out here tend to end up subcontracting, and taking a huge income hit). For any other kind of vulnerability, you're not so much "selling a product" as you are "helping plan a heist".
- mmsc 2y ago>Unmasking Google accounts? Could there be a business there? Sure, maybe. Is there one already? Presumably no. Absolutely, yes. Spam and targeted phishing attacks are in high demand. My understanding is that it is possible to retrieve every public youtube channel ID, if not also Google Maps/Play reviewers, quite easily. This exploit could have been used to create a massive near-complete database of every Google account has automatically had a Youtube account created.
- brookst 2y agoBut then what? Given the number of accounts Google has, odds are that nearly every alphanumeric combo less than 8 or 10 characters plus “@gmail.com” is a google account. This vulnerability gets you other domains, but still not seeing it. Massive databases of email addresses are a dime a dozen. The only angle I can imagine is phishing for high profile creators, and at most this is a “makes it easier” and not a “creates the problem” bug.
- refulgentis 2y agoThe back of an envelope can get you making silly claims quickly (ex. 26 ^ 8 is 208 billion)
- cirego 2y agoI think you might be off by a factor of 10. Alphanumeric would be at least 36 characters, which would imply 2.8 trillion combininations (36 ^ 8).
- refulgentis 2y agoyeah, I was doing the charitable as possible version
- brookst 2y agoNot seeing the problem. Are you assuming that somehow there is at most one Gmail account per person on earth? I have… I’m not sure. Ten maybe? And those are actual conveniences for different purposes. I’m sure plenty of people have hundreds, if not thousands. So what?
- edanm 2y agoI don't remember if I've ever thanked you for the dose or reality you bring to these discussions, but if not - thank you! Before I started reading your comments on bug bounty payouts I'd probably have made the typical thoughtless (in my case) remark that the bounties are tiny, without actually thinking through the realistic dollar value of bugs found. Not to mention not really thinking through how obviously stupid it is to immediately compare a legal activity to a highly illegal one, as if they're real alternatives for most people.
- tptacek 2y agohttps://www.youtube.com/watch?v=Y0pdQU87dc8 https://www.youtube.com/watch?v=Y0pdQU87dc8
- pvg 2y agoI think your comment energy is more https://youtu.be/Pzpx9f5ByyA?t=110 https://youtu.be/Pzpx9f5ByyA?t=110
- tptacek 2y agoA friend generated a tag cloud from all my comments here like 10 years ago and it was just the word "No" like a supermassive black hole ringed by dozens of tiny little words I was saying "no" about.
- pvg 2y agoThat's a great example of "doing it wrong makes it better", in this case not filtering stop words.
- neilv 2y ago> Threat actors buy vulnerabilities that fit into existing business processes Isn't there a market for this? For example, "Reveal who is behind this account that's criticizing our sketchy company/government, so we can neutralize them". I'll also argue there's separate incentives, than the market value to threat actors... Although a violent stalker of an online personality might not be a lucrative market for a zero-day exploit for this "threat actor" market, the vulnerability is still a liability (and ethical) risk for the company that could negligently disclose the identity of target to violent stalker. IMHO, if you're paying well a gazillion Leetcode performance artists, to churn out massive amounts of code with imperfect attention to security, then you should also pay well the people who help you catch and fix their gazillion mistakes, before bad things happens.
- lolinder 2y ago> then you should also pay well the people who help you catch and fix their gazillion mistakes before bad things happens. You missed their point about the business model of the security researchers here: their business model is finding a large number of small value vulnerabilities. Those who are good at this are very very good at this. My company has a bug bounty program and some of the researchers participating in it make double or more my salary off of our program, but we never pay out more than this for a single report. And it's not like we're particularly vulnerable, we just get a steady stream of very small issues and we pay accordingly.
- tptacek 2y agoThey're right: I was talking about the business models at the buyers that these vulnerabilities have to slot into. The point I'm making is: there already has to be an operating business that's doing this for a vulnerability to be salable at all. If there isn't one, you're not selling a vulnerability, you're helping plan a heist.
- lolinder 2y agoRight, I'm only responding to the last part where they imply to these researchers are not well paid. I'm saying that on an hourly basis or monthly basis $10k a vulnerability is actually quite a good payout when you have a surface area as large as Google's to explore and know what you're doing. Their last paragraph shows that they didn't understand your paragraph here: > For people who make their nut finding these kinds of bugs, the business strategy is to get good at finding lots of them. It's not like iOS exploit development, where you might sink months into a single reliable exploit.
- fumplow 2y ago[flagged]
- jovial_cavalier 2y agoThe bounty is not a market. It's a subsidized incentive to subvert the market, and to give greyhat hackers a reason to be white-tinged instead of black-tinged. I would conservatively guess this guy could have found at least 30 people willing to pay $500 for details on this exploit, and he would've netted $5000 more than Google paid him to do the right thing. Probably the risk of going to jail outweighs the extra $5k, but if a company is serious about the bug bounty program, they would offer a reward that's competitive with what you could extract from the black market, and I don't think that's hard to do.
- wepple 2y ago> Threat actors buy vulnerabilities that fit into existing business processes Selling crazy stories to the media is as old as time. This vuln would give you a lookup table from email->YT SELECT * FROM table WHERE email LIKE “%.gov”
- tsunamifury 2y agoAnd? So what. You can spam them? Come on.
- alt227 2y agoOr spear-phish, with a high degree of accuracy knowing the target.
- wepple 2y agoYou don’t think there are folks with content they’d very much not like to be directly associated with them? Comments, videos, likes, etc
- UncleMeat 2y agoAnd so what's going to happen? Are there blackmailing rings that are in active need of ways of tying youtube comments to work accounts that are paying out the nose?
- wepple 2y agoYou don’t think the daily mail would buy a story about how firstname.lastname@nypd.ny.gov posted a comment in support of the KKK?
- nickelpro 2y agoThere's no existing black market of criminals extorting politicians and celebrities over Youtube comments (also how you go from an email address to an identity is itself iffy). You are imagining a potential market, the exploits are priced against markets that are real and pay out today. Security researchers aren't traveling salesmen going around to every shady character on the internet and pitching them on the potential of a new criminal enterprise.
- hedora 2y agoMost other fields of endeavor aren’t compensated based on the black market value of the thing that’s being produced. If we apply your analysis to other things, we’ll find that the upper bound price for a new car stereo or bike is ~ $100, and the price of any copyrighted good is bounded by the cost of transferring it over the network. I think it is more useful to divide the amount Google paid by the number of hours spent on this and any unsuccessful exploit attempts since the last bounty was paid. I’d guess that the vast majority of people in this space are making less than US minimum wage for their efforts, with a six figure per year opportunity cost. That tells you exactly how much Google values the security and preserving the privacy of its end users. The number is significantly lower than what they pay other engineers orders of magnitude more to steal personal information from the same group of people.
- UncleMeat 2y agoBug bounty programs are not the only (or even primary) way that security researchers get paid. Google pays employees salaries to find vulns. Bounty programs are a pretty recent development and the idea that they should be scalable and stable well paying employment for a lot of people is a bit strange to me. If security researchers want to have stable employment doing this sort of work, there's oodles of job applications they can send out.
- mlyle 2y ago> Bounty programs are a pretty recent development and the idea that they should be scalable and stable well paying employment for a lot of people is a bit strange to me. So, the value to the researcher of having a found bug has a floor of the black market value. The value to Google is whatever the costs of exploitation are: reputational, cleanup, etc. A sane value is somewhere between these two, depending on bargaining power, of course. Now, Google has all the bargaining power. On the other hand, at some point there's the point where you feel like you're being cheated and you'd rather just deal with the bad guys instead.
- UncleMeat 2y ago
- kccqzy 2y agoI hate how this HN thread is mostly about discussing the amount of bounty, but I'm afraid it's only natural. Most commenters here are working in the software industry and they want to normalize extremely high bounties. It's an extra income source for them. They want higher bug bounties much like they want SWEs to be a highly compensated profession. It's only natural for workers to demand higher pay for their own profession. No amount of rationalization will change that instinct.
- reaperducer 2y ago[flagged]
- seangrogg 2y agoYou say greed but I would wager that most people in the thread are not financially independent. If someone can't retire from needing money in perpetuity, is it really greed to want to move that needle from "no" closer to "yes"?
- fragmede 2y agoOr even just the next meal. We don't know their situation, and I've heard quite a few stories of the tech-adept being on the streets or behind bars. Some amount of greed is normal. It's when goes way beyond that, into averice that it's a problem.
- iinnPP 2y agoIt isn't always about money, even when that is the stated problem. The dollar value of a responsible report going up means more responsibility overall and less problem leaks, exploits, etc. I would be equally happy to see any solution where the end result is increased security and privacy for everyone, even at zero bounty. The problem being overlooked is that the actual cost of these exploits and bugs is paid by the people who had no say whatsoever in any matter regarding the issue. Any time a company is being "cheap" at the expense of regular people is a bad time, from my perspective. Google has the power to limit the exposure of the people who use there products (and this isn't always voluntary exposure mind you) and is choosing to profit a teeny tiny bit more instead. At no immediately obvious cost to them, why not?
- Cpoll 2y ago> because $10,000 feels extraordinarily high for a server-side web bug. Am I misunderstanding the bug? In my reading, this bug translates to "a list of the top 1,000 Youtube accounts' email addresses (or as many as you can get until Google detects it and shuts it down)." Why isn't that conceivably worth more than $10,000?
- sbarre 2y agoPerhaps because email addresses are kinda/sorta PII (business emails are categorically not) but not quite comparable to home addresses, tax/payment information, etc.. Our emails get leaked all the time in data breaches, sometimes alongside much more important information such as home addresses etc.. This was certainly a bad leak that could be used to further dox people by connecting the email to other leaked info or other sources, but from Google's perspective, all they did was leak the email. It was a privacy breach for sure. But further doxxing based on the email would be "not their problem" I suspect they would say.
- reaperducer 2y agoWhy isn't that conceivably worth more than $10,000? As explained by the parent comment, because there isn't a market for it. It's a novelty. Who are you going to sell that exploit to? At this time, nobody. Since Google doesn't have to compete against others for the bug, it pays low.
- Cpoll 2y agoTo clarify, I'm not suggesting selling the exploit. I'm suggesting selling MrBeast, PewDiePie, Blackpink, Sony Music, etc.'s Youtube email addresses. To phishing rings. Those may be non-public email addresses (admin/billing emails), so the phishing potential is higher than emailing prteam@mrbeast.com (or whatever).
- ipaddr 2y agoI`ll suggest you want the bottom 1000 as they are most likely to fall for a scam.
- maxed 2y agoIt does not make sense to value these kind of (web) bugs by their potential price on the grey market. I think its better to value these bugs by their potential impact, although that is hard to express in money. In this case there were 4 billion email addresses on the line from being scraped, imagine if this was exploited and the data was leaked. The news would hit the headliners which would definitely be bad for Google's reputation and stock price. However, the impact of the leak is not that high as it only consists of a channel <> email address mapping, and therefore I think 10k is a fair price
- harwoodr 2y agoIt sounds like a standard threat-risk assessment applies. How big of a threat is it/what impact will it have on business/reputation/etc.? How likely is it to be exploited and how widely would it be considered useful to the market of threat actors?
- idiotsecant 2y agoIf the value of the bug payout is equal to the grey market payout, why would I ever sell it to Google? I could sell it on the grey market and not pay taxes on the sale, or worry about cumbersome reporting requirements. Google plays a dangerous game with this logic.
- dadrian 2y agoI'd also add that the legality of law enforcement exploiting a server-side bug is much more of a gray area (or actually illegal), whereas there is a standard process for law enforcement or the intelligence community to get a court order that enables them to exploit devices that belong to a specific target (phone, laptop, etc).
- tptacek 2y agoThere's also the thing where like, as you go from iOS Safari to Windows Chrome to Acrobat Reader or whatever, grey market prices plummet. The top-dollar targets all have multilayered runtime protections and whole teams that do nothing but security refactoring. No serverside software is hardened that way (excepting the Linux kernel, maybe, but Linux kernel bugs are a standard component of clientside exploit chains). You could infer a pretty low price. I will say: at Matasano, we were once asked by an established security company that turned out to be a broker to find PHPBB vulnerabilities.
- gxs 2y agoThe fact that the amounts in apple's bounty program can range from 5k-500k for a single category tells me that the answer is it depends. It's most likely not just a comparison to black market prices or how many lines of code it'd take to patch. https://security.apple.com/bounty/categories/ https://security.apple.com/bounty/categories/
- newsclues 2y agoWhat’s the value of the mailing list with every YouTube users email address ?
- kazinator 2y agoThe discoverer had these choices: - monetize the bug themselves; i.e. set up a site where you can submit a YouTube user id, pay some fee using your credit card and get an e-mail address. - report that they have the ability to convert any YouTube id to an e-mail, with proof: then negotiate over compensation for the disclosure of the details - just report the problem and be happy with whatever they get. Ten grand doesn't look too bad for the most timid choice.
- nightpool 2y agoDo any companies pay bounties for path #2? My understanding is that it's forbidden by most bounty programs since it could be seen as a form of extortion. For #1, as tptacek says, it would be trivially easy for Google to shut a service like that down as soon as it was created, and prosecute the people running the service under the CFAA. Also, the amount of demand for that kind of data is pretty small given the number of email address databases already available online through legal means (e.g. Zoominfo, RocketReach, etc). It's a path filled with a lot of risk and not a ton of reward.
- kazinator 2y agoIn other words the more you think about it the better the $10k looks.
- benmmurphy 2y agoThere is kind of a market for server side vulnerabilities but I'm not sure if you would call it grey. I suspect ZDI will purchase commodity server side vulnerabilities (https://www.zerodayinitiative.com/ https://www.zerodayinitiative.com/). So stuff like apache, nginx, and maybe opensource webapps that have a narrower usage.
- tptacek 2y agoZDI claims they'll pay for bugs in serverside software, which is a different meaning of the term "serverside" than I'm using (admittedly, that definition is more precise). An nginx bug has a half-life once discovered. A Youtube bug does not. I'm a little skeptical of published prices for serverside software, though. Do you know anyone who specializes in selling those bugs? I don't.
- deleted 2y ago[deleted]
- KennyBlanken 2y ago> that has effectively no half-life once discovered Google knew about this already, and hadn't done anything to fix it...and when it was reported, they didn't fully understand it and were dismissive, until the author came back at them again. > Unmasking Google accounts? Could there be a business there? Sure, maybe I'm pretty sure there are a _lot_ of youtube channels that private and public entities would love to uncover the identity of, and I would say that it's very unlikely these guys were the first to piece all this together. The main takeaway for me is how incompetent Googlers seem to be, both in the basic "web application 101" mistakes made (not properly validating/restricting fields) and the clearly rushed evaluation of the security report. Such a report should trigger some folks going "oh, that's not good. I wonder what else is broken about this." Not "meh, not significant, quick patch, fixed." Nobody at Google wants to work on stuff that isn't going to get them up a rung on the ladder.
- EGreg 2y agoIf you think Google had underpaid for this, imagine how much they got to underpay for this: https://www.theverge.com/2016/1/29/10868404/google-reveals-how-much-it-paid-the-guy-who-bought-google-com https://www.theverge.com/2016/1/29/10868404/google-reveals-h... That guy is ridiculous! Could have made $50 million or more probably, if he had used a different registrar than Google itself. He mentioned that Microsoft also let their domain lapse and that one was actually going to the open market... and what's more, they didn't even care when he contacted them! Oof: https://www.theregister.com/2003/11/06/microsoft_forgets_to_renew_hotmail/ https://www.theregister.com/2003/11/06/microsoft_forgets_to_... Here are a few other doozies: Apple forgot to renew their certificate for the entire Mac App Store, and didn't care much: 2014: https://www.macrumors.com/2014/05/25/apple-software-update-invalid/ https://www.macrumors.com/2014/05/25/apple-software-update-i... if that wasn't bad enough... they did it again in 2015: https://osxdaily.com/2015/11/12/fix-app-is-damaged-cant-be-opened-error-messages-in-mac-os-x/ https://osxdaily.com/2015/11/12/fix-app-is-damaged-cant-be-o... and almost in 2016: https://apple.stackexchange.com/a/227787/75628 https://apple.stackexchange.com/a/227787/75628
- zeroq 2y agoOn top of that I always felt that this is generally aimed towards hobbyist who may accidently stumble on something to give them additional incentive to finish the job and make an actually summary and repro, rather than hollywood hackers. Sure the gray market will pay more, but how do you contact criminals and make sure that you actually receive payment? I know nothing about the market, but I think it's similar to buying drugs - we all know that drugs are everywhere and criminals are making a ton of money out of it, but if you haven't been introduced before how do you actually buy them? Go to a club and start asking random people? (that last part might be different in US, but in EU we don't have people standing on every corner selling cookies)
- midtake 2y agoDisagree. 10k seems low considering the value to those who ship OSINT services this would have had. Such services get data from very interesting places. I also wouldn't call it just a server-side web bug, it's more like data exfiltration. TFA author could have sold it for more money to some gray market dudes if he were willing to accept bitcoin.