6 ms·
Gmail/G Suite now editing URLs in mail message bodies to use Google URL redirect
- sneak 6y agoThis also breaks GPG clearsigned messages that have URLs in the body, as demonstrated in this message I just sent myself: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hello, please visit my site at https://www.google.com/url?q=https://sneak.berlin&source=gmail-imap&ust=1603637677000000&usg=AOvVaw2HZaWQujRWlDNrZMKZIsed. Best, - -jp -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEVTmtAN5MQvOv4RV1BSRD9N8qVcIFAl+MVwwACgkQBSRD9N8q VcLgzRAAln4mjtvlwqBIDKA8RFfTP/VwX4SuV1n7Ux5FrdNY1htde5Nkxu/wIcE7 hz5VbdclvUrKP8lpb6LTU7UuV73aaN48QfGKhDmRkokiflR6uoisr9CBnLooD6Iw 4KpU8Puqh+LgHRbP2AYZ3Qm//g9sJqdziC8/tATizE+yk8wcIqKihXzp+y9fYWNs UYv92/k6MivxqvM4r6IELJ8tOBSRu1lYKFsuI4GuYmPlnk2UqodlCUpWByaETezO NtkUvOVnIvt02hpliu36LSDeIquVio2eVjYJrvGvMpyWTW3MFG9BI0Tcgxbj3lsS DL9wOxhNeRPLYG91DtP+eIYsYZWigkGNQ8PMRfXcpjDN49ei//iN6Pvopn6txSnQ u9lELP8Td+tEXAlUnNzlE3d1WAARve9iG1SnAFDk+vfWEaEvEoZl9ZiHuH57jPF2 9ggAOeGKaEAlF74Ekjs0Xrct5WDzy2FF3d+TE5e1Nzx+vwLBaRuWLVJO+iPUlbLv MHAwmCp5zNIB2r8sbBDATBUHaggFXV/k5H+wTjmB2kLALq/OD9tSfjNfjEUKcpM/ FGK/AOh8NjwR28n9f1uMutYBrs2KPqjZlW88zNu90Wg0OAk91L9jmz3trH2PYrKs rlg2hQzBdOIY1/1LeUBoDkcQiqP2neg2ae/XF26qSarUVKcwAhM= =jmVc -----END PGP SIGNATURE----- I'm also probably doxxing myself by posting those ust= and usg= values unredacted. :(
- abdullahkhalids 6y agoTest messages to myself from Thunderbird and from gmail web interface did not get rewritten. How can I replicate this?
- sneak 6y agoSend me an email at sneak@sneak.berlin and I'll send you my G Suite address that you can send a test message to that contains a URL, and I'll forward it back to you from my non-G Suite account so you can see what happens.
- nullc 6y agoIt's better if people can reproduce it without your involvement so that the result is independent of you. Perhaps some law enforcement agency has asked google to specifically track URLs in your messages and it's just you seeing this.
- est31 6y agoProbably an A/B test for now, so only a limited number of people have this issue.
- gjvnq 6y agoMaybe you have to write the message in HTML
- est31 6y agoIs the Google-provided signature intact at least? IIRC they provide a special header with a signature inside.
- megous 6y agoust is a timestamp. usg is probably some kind of HMAC (q || ust, secret) so that only google can generate the redirecting urls. If you change the usg, the redirection fails. The same happens if you change ust or q.
- Proven 6y agoIt's for your security, and the children
- djbebs 6y agoHow can this be legal?
- randomperson321 6y agoWhy wouldn't this be legal?
- londons_explore 6y agoIt's to protect the privacy of the Gmail user - it means the website doesn't get to know that you came from gmail.com. Google doesn't get any extra info, since they already had all your email contents and you already had a privacy agreement with them. One could argue that they have to do this to meet the law.
- oefrha 6y ago> it means the website doesn't get to know that you came from gmail.com. That's entirely solved by Referrer-Policy: no-referrer, so no. https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Referrer-Policy https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Re... (Unless you're talking about someone using another webmail client that doesn't set the header, which would be a stretch.)
- brirec 6y agoThis only works for inline images because Google caches them, and then you get the images from Google’s cache. It has nothing to do with external links. If Google redirects you to a website, you’re still going to the website. Unless Google internally follows all the links in emails it won’t do anything to help spam. Not to mention all tracked links I’ve ever seen track primarily based on the URL itself. Additionally, Google adding a redirection step won’t save anything, except show via HTTP Referer that you were linked to this page by Google. If you clicked the link from a desktop IMAP client you’d have no referer, so this is a net loss for privacy, not a gain.
- GuB-42 6y agoBecause you agreed to it. Somewhere in the terms of service: > This license allows Google to [...] modify your content, such as reformatting or translating it
- stephc_int13 6y agoI've planned to quit using Gmail for a long time now. Any tips on how to do it efficiently? I would prefer a native email client coupled to a simple hosting solution.
- randomperson321 6y agoI use Tutanota.
- devinegan 6y agoI moved to fastmail. Biggest pain was all my filters that I ported to their rule syntax and still manually maintain. I believe they have a better way to do this 5+ years later, but that is my experience.
- CitrusFruits 6y agoI moved to fastmail earlier this year. Honestly, it took a full day of updating all my accounts on every site that used my email. It helps to have a password manager to keep track of progress. Since then it's been pretty good. I keep my old gmail as an additional account on my email client to track things I've missed, but it's been surprisingly little.
- jhardy54 6y agoUse your own domain! That way your email address isn't paired with your email host.
- defnotashton2 6y agoSrsly, 12$.
- nvr219 6y ago1. Get Fastmail 2. Forward all your email from gmail to Fastmail. Use this time to update your contacts, etc. 3. After 30 days disable gmail forward. You will probably keep the email address for spam. For Calendar - you can have fastmail pull your gmail calendar. Keep that in place to help transition recurring meetings to fastmail, and then eventually you can sunset that too. Do invest in your own domain name so that if you need to leave fastmail in the future you can do that more easily.
- oefrha 6y agoCan't reproduce on either Gmail or GSuite, including on webmail (I thought this could be some sort of "you're leaving example.com, do you really want to do that" thing, but nope). The part about IMAP being affected sounds especially suspicious. Knowing op's track record I'd rather hear from some more impartial sources.
- sneak 6y agoMy track record? If you're going to accuse me of lying, I'd prefer that you do so overtly and put your own credibility on the line. https://twitter.com/sneakdotberlin/status/1317838356382797824 https://twitter.com/sneakdotberlin/status/131783835638279782... It says source=gmail-imap right in the URL. Look.
- oefrha 6y agoSorry, you have a history of making wild accusations like this: https://news.ycombinator.com/item?id=21109530 https://news.ycombinator.com/item?id=21109530
- jollofricepeas 6y agoAgreed. His “evidence” means nothing and his background is very shady. Those screenshots could be completely made up. Can someone else verify with raw data?
- bArray 6y agoI've tried from both GMail and Thunderbird, not able to repeat the experiment.
- megous 6y agoScreenshots are not completely made up. At least the `usg` HMAC seems to be valid, and timestamps are recent enough, so the redirector URLs are legit. Of course it's possible to generate the valid redirector URLs in other ways. So if this is a scam it's not a completely stupid scam. Anyway, A/B testing or gradual deoployment is a thing. I'll not turn against a fellow hacker and call him shady, just because a potential A/B gaslighing practice from some megacorp. ;) I'll just wait.
- ISL 6y agoIs there a reason that this would ever make sense for the end-user? If I click on a link, my browser opens it. Done, right?
- lern_too_spel 6y agoPresumably to hide Gmail as the referer on browsers that don't support it. It doesn't make sense in the IMAP case. https://caniuse.com/referrer-policy https://caniuse.com/referrer-policy
- asdfasgasdgasdg 6y agoThey can also use this for phishing prevention. There are probably other ways to do it -- e.g. you could rewrite the url dynamically at read time if it's been detected as a phishing attack -- but using a redirector is likely simpler. Tbh I'm struggling a little to understand what the threat model is here. You trust gmail to receive and handle your email. In the vast majority of cases, you're accessing the email through their web frontend, where they could easily detect hovers and clicks and log those with fair reliability, if they had nefarious ends in mind. But them using a redirector is a bridge too far? If you trust them to do the first two items, it seems a little far fetched to distrust the last.
- genocidicbunny 6y agoIf they're rewriting emails that you send out, that allows them to also track what the recipients of the emails do, even non-gmail ones. And not every gmail user uses the webmail interface either -- many use standalone clients that wouldn't normally have this tracking. Also, there is something very wrong when we're okay with Google rewriting parts of our emails. How long until they decide to start modifying other bits of our emails? Reading the contents of the email is one thing, modifying it from its original is a whole 'nother ball game.
- asdfasgasdgasdg 6y ago> If they're rewriting emails that you send out That's not the claim. The claim is that they're rewriting urls you receive. I suppose if the imap claim is true, and you reply, and you quote the redirector url in your reply, and someone clicks that link, they could detect it. That seems a little annoying and presents a slight risk, but it doesn't seem like the type of thing that would be intentionally designed in, even if I model google as completely amoral and short-termist. There just doesn't seem to be much advantage in it. > And not every gmail user uses the webmail interface either That's why i said the vast majority of cases, not "all." :)
- phreack 6y agoThis is really urgent if it goes beyond A/B. Possibly even illegal already under some interpretations. It'd finally make me leave Gmail for sure.
- tjoff 6y agoWhy would the outcome of the A/B matter? The writing is on the wall. Maybe get out now rather than waiting for the frog to get cooked.
- defnotashton2 6y agoIs the another non chromium browser that can handle more than 5 extensions? Ff extension management is terrible which i find unusable in an age where I need extensions to prevent sites from removing usability features like select, copy, and paste. I'm using brave but I don't fully understand how it's related to chromium and if it's a true fork that they are going to be able to maintain independently. I have many many extensions in brave and an extension manager that let's me toggle them right from a drop down. Any suggestions?
- coddle-hark 6y agoThis is about gmail, not chromium, but nevertheless: If you’re not willing to adapt your workflow to something other than chromium, maybe you don’t value your privacy as much as you think you do.
- defnotashton2 6y agoCorrect I value basic usability (the ability to use many plug-ins in this case) over privacy. This is why I don't use proton, cause I can't actually get anything done with it.
- berkes 6y agoIn that case, I'd urge you to tone down your negative criticism on Firefox. You've already decided that you are not willing to use it over issues you have with it: that choice is fine. Telling others in relevant discussions why you made that choise is, too. No-one asked you why you chose not to use Firefox in a thread about Gmail. Yet you managed to inject your FUD here nonetheless: Firefox can handle 5+ addons just fine. But now some random passersby might get the impression that Firefox is a burning dumpsterfire based on random negative critiques that aren't even in the right place nor true at all. That helps exactly no-one.
- jgalt212 6y agoThe recent actions of Big tech confirms to me that they believe any upcoming anti trust enforcement will have no teeth.
- sebbyy 6y agoI can't reproduce this. I tested it on both Gsuite and Gmail account.
- jagged-chisel 6y ago"Now?" Has this not always been the case? I tend to use the web UI on my desktop which, IIRC, has always made links bounce through a Google. I use an app on my mobile device so I can't confirm whether links bounce through Google. Is Google rewriting the links in the message such that if I forward to someone's non-Gmail address, they still bounce through Google? Or is the client 'rewriting' links dynamically? This same thing happens all over the web. Drop a link in your Medium-hosted blog, and they'll front the link with their own and then redirect. What's the new, surprising bit here?
- jeffbee 6y agoCan't repro. Links in text/plain, HTML, and mixed survive round trip through Google. Suggests that whatever client the OP is using is confused by the data-saferedirecturl attribute in Gmail's web presentation?
- andor 6y agoYes, I think he is talking about the data-saferedirecturl attribute. He's not wrong though, as the redirect stored in the attribute is loaded when you click a link.
- frob 6y agoI'm also unable to reproduce this. This feature could be behind an A/B test, but this is just one additional data point.
- easton 6y agoSo just like Microsoft has literally done for years?[0] I don't know how many times I've clicked on internal documentation that has a link that went through Outlook at some point and was wrapped in a safe link. It's designed to catch bad links without safe browsing in your browser (which things like IE and old Edge didn't have). 0: https://docs.microsoft.com/en-us/microsoft-365/security/office-365-security/atp-safe-links?view=o365-worldwide https://docs.microsoft.com/en-us/microsoft-365/security/offi...
- greatgib 6y agoIt is already annoying that they do that with search results. Does anyone know a good/open source extension for chrome and Firefox that de-google the link before you click on it?
- edoceo 6y agoI saw something like this recently. I right-clicked to copy a link in a message, pasted to chat and it was google.com/url?url= like link. I'm not able to repro at the moment. I manage a few domains in G, I'll keep poking.
- tcombinator 6y agoSee my longer replies in the thread, I've tested this extensively and can reproduce it reliably. Please report this to google to help back my claim which they of course are casting doubts on left right and center.
- nashashmi 6y agohttps://stackoverflow.com/questions/5172168/why-do-links-in-gmail-redirect https://stackoverflow.com/questions/5172168/why-do-links-in-... Why do links in gmail redirect?
- aimor 6y agoI hate the Google redirects because they are noticeably slow. They did more to move me off Hangouts than anything else. They also plague Google News, but AMP is slowly "fixing" that problem.
- megous 6y agoMe too. Noticeably slow is a bit of understatement. Often times, I have to wait >4s for a redirect, which is kinda infuriating, given that I know it's not the issue of the actual website, just google messing with the URLs. Why does all the SPDY nonsense matter when Google adds huge latency in other ways.
- deleted 6y ago[deleted]
- trident1000 6y agoIts been a long run with gmail but I'm going to make the full leap to protonmail pretty soon. It takes a little work to migrate things but I just cant stand gmail for so many reasons now. And after Google pay thought it was a good idea to send my phone number out to every online merchant (I now get nonstop spam texts and calls) I've had it with the company.
- woodruffw 6y agoI can't reproduce this either, so I'll ask maybe a simple question: how does URL-rewriting benefit Google in this situation? Google already knows the bodies of emails and can do whatever analytics they please on them. The vast majority of users are also using it via their web client, meaning that Google can put arbitrary JavaScript on the page to record which links are being clicked on. They already have most of the metadata that they could scrape from a rewritten URL, since you're already on their property. It's possible that I'm missing something, but it feels like it's a lot of effort for information that Google already possesses.
- berkes 6y ago> how does URL-rewriting benefit Google in this situation? When I use, say, thunderbird, Google does not know whether I opened an email, interacted with links on them or downloaded images/external resources in them. With link-rewriting, when I click on e.g. shopping.example.com/product/1337 and not on shopping.example.com/product/42 in an email, google now knows that "berkes, thunderbird-user is more likely to like product 1337" and can offer that data to advertisers.
- TooCreative 6y agoI can reproduce it on gmail.com Google seems to hide this via Javascript. To reproduce in Chromium: Enable dev tools, enable "Preserve log", go to settings and enable "Auto-open DevTools for popups". Then click on a link in a mail. Now you can see under the Network tab, that the new window did not go to the link you clicked but to a Google redirect url. I guess Google outputs a normal link in the html but then intercepts the click and sends you to their tracking url. As nobody seems to be able to reproduce it for IMAP, I guess that either A) the author is in an a/b test group that got targeted with the tracking links or B) he uses an email client that uses some other protocol or C) He is outright lying or D) Something else. My money is on B. The author says on Twitter he uses mail.app on a Mac. I would not be surprised if the developer of a hip shiny Mac app happily used the newest shiny API from Google. Can someone with a Mac and that app reproduce it?
- jeffbee 6y agoGoogle has been rewriting the click target in gmail's web presentation for years. That is not the same, or even related, to changing the URL in the email itself (as presented by SMTP or IMAP).
- oefrha 6y ago> Google seems to hide this via Javascript. I'm like 200% sure Google can't "hide this via JavaScript" (whatever "this" means) in my native mail client if they have actually rewritten the URLs, which is the accusation here.
- TooCreative 6y agoThat is why I said "on gmail.com" which is Googles web interface. I don't use a local mail software.
- soraminazuki 6y agoBut you said in another comment that you couldn't reproduce the OP's accusation "including on webmail." Gmail has been rewriting links in the web interface for all users using JavaScript for years now.
- hnarn 6y agoThis doesn't seem to be new, there's a Medium post from a year ago[1] talking about how the "data-saferedirecturl" attribute is used by Google to track clicks with Javascript, there's a question on support.google.com[2] with 100+ upvotes and no response asking what this attribute is for and how to disable it, and it even shows up in an internal (at least, targeted towards internal readers) U.S. Department of the Interior page which explicitly states that employees should not paste links from Google[3]. It's worth noting that this also happens on the "HTML version" of Gmail. [1]: https://medium.com/@ohadinho25/googles-gmail-tracks-link-clicks-in-e-mail-messages-281c47a9d48a https://medium.com/@ohadinho25/googles-gmail-tracks-link-cli... [2]: https://support.google.com/mail/thread/12875647 https://support.google.com/mail/thread/12875647 [3]: https://www.doi.gov/employees/drupal/links https://www.doi.gov/employees/drupal/links
- justaj 6y agoThis was already happening in the HTML version of Gmail, like well a couple of years before as I remember.
- anjbe 6y agoNobody here has mentioned that sneak is using Google’s “Advanced Protection” feature: https://twitter.com/sneakdotberlin/status/1317870945059495936 https://twitter.com/sneakdotberlin/status/131787094505949593... Advanced Protection is that ultra‐secure mode that requires hardware security keys to login and prevents third‐party apps. Here’s a quote from its advertising copy: > Protection against malware is built into Google Chrome, but Advanced Protection performs even more stringent checks before each download. It flags, or even blocks you from downloading files that may be harmful. Sounds an awful lot like what’s going on here. It would explain why nobody’s been able to reproduce it—almost nobody has AP turned on. I imagine the number of people 1) with AP turned on 2) using a third‐party mail client (mail.app) 3) viewing plaintext mails instead of HTML mail where the link rewriting is less obvious must be close to zero.
- tcombinator 6y agoI can confirm this has nothing to do with that as I do not have it enabled on my account and can reliably reproduce the issue. See my other replies in the thread for more details.
- rhabarba 6y ago"Google Mail Considered Harmful"
- tbodt 6y agohttps://support.google.com/mail/answer/10173182 https://support.google.com/mail/answer/10173182
- brodyerik 6y ago<a href="https://www.google.pn/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.pn/url?q=https://ozrollies.com/">ozrollie... <a href="https://images.google.co.zm/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.co.zm/url?q=https://ozrollies.com/">oz... <a href="https://maps.google.co.zm/url?q=https://ozrollies.com/">ozrollies</a> https://maps.google.co.zm/url?q=https://ozrollies.com/">ozro... <a href="https://www.google.co.zm/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.co.zm/url?q=https://ozrollies.com/">ozrol... <a href="https://www.google.vg/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.vg/url?q=https://ozrollies.com/">ozrollie... <a href="https://images.google.rw/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.rw/url?q=https://ozrollies.com/">ozrol... <a href="https://images.google.com.bn/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.com.bn/url?q=https://ozrollies.com/">o... <a href="https://www.google.com.bn/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.com.bn/url?q=https://ozrollies.com/">ozro... <a href="https://images.google.fm/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.fm/url?q=https://ozrollies.com/">ozrol... <a href="https://maps.google.fm/url?q=https://ozrollies.com/">ozrollies</a> https://maps.google.fm/url?q=https://ozrollies.com/">ozrolli... <a href="https://www.google.fm/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.fm/url?q=https://ozrollies.com/">ozrollie... <a href="https://images.google.je/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.je/url?q=https://ozrollies.com/">ozrol... <a href="https://images.google.im/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.im/url?q=https://ozrollies.com/">ozrol... <a href="https://maps.google.im/url?q=https://ozrollies.com/">ozrollies</a> https://maps.google.im/url?q=https://ozrollies.com/">ozrolli... <a href="https://www.google.im/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.im/url?q=https://ozrollies.com/">ozrollie... <a href="https://maps.google.kg/url?q=https://ozrollies.com/">ozrollies</a> https://maps.google.kg/url?q=https://ozrollies.com/">ozrolli... <a href="https://www.google.kg/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.kg/url?q=https://ozrollies.com/">ozrollie... <a href="https://images.google.la/url?q=https://ozrollies.com/">ozrollies</a> https://images.google.la/url?q=https://ozrollies.com/">ozrol... <a href="https://www.google.la/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.la/url?q=https://ozrollies.com/">ozrollie... <a href="https://www.google.co.ao/url?q=https://ozrollies.com/">ozrollies</a> https://www.google.co.ao/url?q=https://ozrollies.com/">ozrol...
- brodyerik 6y agohttps://try10.com/cheapest-4k-graphics-card/ https://try10.com/cheapest-4k-graphics-card/ https://try10.com/how-to-unblock-adobe-flash-player/ https://try10.com/how-to-unblock-adobe-flash-player/ https://try10.com/best-motherboard-for-i9-9900k/ https://try10.com/best-motherboard-for-i9-9900k/ https://try10.com/best-gpu-for-ryzen-7-2700x/ https://try10.com/best-gpu-for-ryzen-7-2700x/