6 ms·
> How do software developers understand which parts of their software are being used and whether they are performing as expected? By asking nicely. Not by siph
by hulitu 4y ago
> How do software developers understand which parts of their software are being used and whether they are performing as expected?
By asking nicely. Not by siphoning data out of my system.
Where is this world going ? Do i really have to treat every program as spyware and restrict its internet access ? And anyway, why would a compiler need internet access ?
- fancl20 4y agoAsking nicely doesn't work in pratice because people willing to answer the question is not a randomly sampled group of people and usually highly biased. You can check how polling works and why it doesn't work. The problem is always how to randomly sample people and AFAIK there is no good way except randomly sample people (a.k.a telemetry). You can argue that developers shouldn't care that much about their software are being used and whether they are performing as expected, but asking nicely really is not a solution. APPENDED: PLEASE NOTE I'm saying asking nicely is not a solution to get correct data from statistical standpoint. You can argure the data accuracy is not important in this context.
- ballenf 4y agoIsn't it contradictory to "care" about how privacy objectors use Go, while denigrating those people by suppressing their voices?
- hobom 4y agoWhile true in general, it is really not that necessary to have a representative sample for checking whether your software works. With large enough sample size a convenience sample will find almost all of the bugs that telemetry would have found.
- hn92726819 4y ago> Asking nicely doesn't work in pratice LLVM, GCC, rust, zig, D, etc don't have telementry and they seem to be doing fine. What makes go special? They aren't trying to be more efficient than rust. It isn't more widely used than GCC. I would argue they don't need this telemetry at all.
- arp242 4y agoNo one claimed it's essential to have telemetry or that a language literally can't do without it. After all, Go is doing fine without telemetry too. But that doesn't mean it's not useful, for Go but also gcc, or Zig, or D, or any other language. A long list of use cases is given here: https://research.swtch.com/telemetry-uses https://research.swtch.com/telemetry-uses
- BiteCode_dev 4y agoUseful doesn't mean it should be done. There are a ton of useful things for me I don't do because it's not right to do them. Apparently as soon as a company becomes big enough, the line between convenience and ethical becomes very blurry.
- arp242 4y ago> Useful doesn't mean it should be done. I never said anything about what should be done. I'm just saying it is useful, as the previous commenter said it's not.
- hn92726819 4y agoWhen did I say it isn't useful? I said they didn't need it. They also don't need to install a kernel module that records every keystroke and memory access, but it would certainly be useful data.
- acdha 4y agoHave you asked core developers of those languages how they feel about this? I'd bet that you'd have near unanimous agreement that this class of information would be useful for informing support decisions. Where I'd expect difference is precisely over the question of whether it's worth the cost & trust issues. That makes me wonder whether there might be some middle-ground here where some third-party like the Linux Foundation could run a telemetry service which is highly public in both its design and collected data, and whether that would be enough that many people would be comfortable with this kind of service without Google's business reputation entering into the equation.
- tom-thistime 4y agoI'm confident that you're not jumping from "asking nicely is not a solution" to "using force or deception is fine." It's just that, if the argument in my last paragraph did become widely accepted, it would lead to a pretty brutal society. (And, of course, it is becoming pretty widely accepted where software is concerned.)
- Retric 4y agoBiased sampling only matters if the bias has some relevance to what you’re investigating. There is zero reason for software telemetry to care about privacy bias.
- sixbrx 4y agoMy code is on GitHub as is a large number of other peoples. They can try to compile it themselves with all the profiling and probes they want, on their own machines.
- acdha 4y agoThat's not the problem they talking about. It would be useful in some cases (and I'd be surprised if they haven't already considered experiments along those lines) but what you have on GitHub doesn't easily tell them about your build or runtime environments. Here's a long list of questions Russ Cox was interested in - notice how many of them would really want something like “what is your CI configuration?”, and consider that while they could sample GitHub Actions configuration that doesn't tell them anything about the much more varied set of projects who don't use that service: https://research.swtch.com/telemetry-uses https://research.swtch.com/telemetry-uses
- api 4y agoThat's a very forced, contrived, un-impressive list. It reads like someone told them "hey, we want telemetry, please make up a list of uses that will sound plausible to programmers to justify it. Be sure to use big words like histogram a lot to shut down objections by sounding real smart." Most of these things are in the category of bug prioritization. Why don't you... you know... talk to users? If you want some statistics (oh sorry, histograms), maybe pull down the gigabytes and gigabytes of Go code residing on public repositories and places like GitHub and analyze all that. That'll tell you a ton about how people structure their projects, what architectures they target, etc.
- fsflover 4y agoBy using telemetry you are losing the statistics from people who block it, i.e., the most tech-savy users.
- justinclift 4y agoThis may be by design, as it punishes those who dare to value their privacy. eg, some options: a) No telemetry. All users of the Go language get equal treatment/consideration by the developers ("best guess"). b) With telemetry. The users who opt out are thereby excluded from consideration ("punished"). It seems like over time, option b) would lead to problems for the Go language as the developers base their decisions on incomplete information, whilst believing that information is somehow more complete than option a).
- arp242 4y agoI'm not entirely sure how biased the data would be; there needs to be a correlation between "frobs with telemetry" (whether it's opt-in or opt-out doesn't even matter) and any other metric. I'm not so sure there is one, although perhaps there could be – we need telemetry to demonstrate that :-) Questions about bias in reported data are legitimate and a genuine topic of concern, but this: > This may be by design, as it punishes those who dare to value their privacy. Is just veering off in the conspiratorial.
- justinclift 4y ago> Questions about bias in reported data are legitimate and a genuine topic of concern The problem is an obvious one but doesn't seem to be considered. :( > Is just veering off in the conspiratorial. Punishing people who value their privacy seems like it'd be strategically useful to Google, an ad company with demonstrated intelligent but sometimes ethically challenged people. ;)
- esskay 4y agoThe bigger question is why do they suddenly need this to such a degree that they need to do a backhand tactic to get the data? Most other programming languages have no such data and have survived and thrived for years, decades even before Go existed.
- puszczyk 4y agoIt seems like it’s only a proposal at this point? Generics were also controversial and it took multiple iterations and years to get them done. I wouldn’t call it “suddenly”. Also, why do they need the data “suddenly”? What do you suggest?
- acdha 4y agoIt's neither sudden nor backhanded — if either of those characterizations were accurate, we'd have learned about it from something shipping. Announcing it publicly before implementing anything and having a number of privacy protections built-in suggests neither is a fair description. Reading through the use-cases at https://research.swtch.com/telemetry-uses https://research.swtch.com/telemetry-uses one thing to consider is that these are the kinds of things people care about as a project matures — once you have a large number of people depending on your project, you have to worry more about unintended consequences as you evolve and since the user community has grown larger and the project more stable it's also harder to know whether the people you hear from regularly are representative. When a project is small or mostly used by enthusiasts you can be more confident that your understanding of what people are doing is relatively accurate but that just isn't true over time. For example, how many millions of Java developers never contact Oracle or the OpenJDK developers throughout their entire careers?
- AlexandrB 4y agoThe same argument could be made by many other entities include government bureaucrats and LEOs. Justifying data collection with "it makes my job easier" is a very slippery slope IMO.
- deleted 4y ago[deleted]
- groestl 4y ago> Asking nicely doesn't work in pratice Well, to bad. Because if you don't, you've built a piece of malware, by definition. You need to ask, live with bias, and draw your conclusions accordingly.
- deafpolygon 4y ago> Asking nicely doesn't work in pratice Who cares?! It's about respect for individuals and respect for their privacy. Any kind of telemetry should be opt-in no matter how you spin the PR.
- salawat 4y agoYou seem to have a problem understanding the concept of consent. Allow me to help you. You ask first. If the answer is no, you don't do it. If you cannot master this skill, or refuse to, you are embarking on becoming one of the most problematic demographics on Earth. There is no excuse for not asking, and honoring the answer. Sending data is not free, and I guarantee your telemetry is not that important, neither is your vaunted sampling. All you want is to know who your Users are, and the fact is, that is fundamentally gated behind them wanting to even bother telling you.
- tinus_hn 4y agoIt’s a simple value proposition: want priorities for your problems and use cases? Turn on the telemetry. Just like answering polls makes more of a difference than voting.
- creepycrawler 4y agoThe world was already there, your bubble just burst. In recent decades tech companies and their programmers have done everything they can to collect data about users. Are you now surprised that the same companies apply the same practices for technical users of their software? The solution, at least for me, is to remove that software from my life. Personally I vowed a long time ago to never work for a company whose business is to track people. It's no big deal for me, but I understand at least some may have hard decisions to make.
- alkonaut 4y agoBeing able to monitor the system is one of the big reasons to move to web based applications (another being e.g. ease of deployment). If monitoring of the application isn't possible (And by possible I mean reliably statistically so opt-out not opt in) then that will drive the shift to centralized/web based applications even faster. Ironically, those who are most wary of telemetry tend to be the same people who also appreciate being able to run local software over web based.
- creepycrawler 4y agoNot sure what your point is. With regards to the last sentence, I don't see the irony. People who don't like being tracked like local software, yes.
- alkonaut 4y agoThe irony I mean that the tracking will be there regardless, the suppliers of software will use "we can't monitor the app sufficiently at end users unless we centralize it" as the argument of not making client side software at all.
- nishs 4y agoThat's an overarching claim. I write some paid local-only software, and I have no trouble not tracking users or usage. For example, here's the entire privacy policy for one of them: > App does not collect any data. > App works completely on-device. Messages do not leave your iPhone and are not shared with other apps. > The essence of this privacy policy will not change. -- For another software, the privacy policy includes details such as: > App never uses the Internet, except to check for updates. > Automatic update checks can be turned off in the application's preferences. Requests to check for and to download updates happen only through the domain domain.example. The updates server does not store or forward potentially identifying information, such as request IP addresses or user agent strings. > License keys, obtained upon purchasing App, do not contain personal information, such as names or email addresses of license holders. License keys are validated locally; App does not use the Internet to validate license keys.
- threatofrain 4y agoOr by paying for it. Google is a powerful & wealthy company and Go is under Google's direct control.
- alkonaut 4y agoPaying how? People tick a box saying "If you tick this, we'll report how many cache misses your compilation passes did, and in return you'll get a gift card after 10k compilations"?
- liveoneggs 4y agoWhy give away a gift card when they can use the data collected from your computer via the compiler to sell the opportunity to sell you a targeted gift card?
- alkonaut 4y agoNot sure if serious, we are talking about data collection with zero chance of any practical targeted use. The discussion would be a wholly different one if the data could be used for anything to e.g. sell, target ads or even deduce how/whether an individual has even used the application.
- liveoneggs 4y agoThe data can obviously be used for things or google wouldn't pay for servers to collect it?
- alkonaut 4y agoYou sounded like you meant it could be used to target individuals, and not just draw statistical conclusions about the software. Those are quite different things. Every company that does "anonymous usage statistics" (which is basically the norm these days at least for larger apps) obviously have some use for the data or as you say they wouldn't be paying for the functionality.
- alkonaut 4y ago> why would a compiler need internet access It doesn't. It compiles without internet access. If it has internet access it can also send telemetry data. If the compiler refused to work in all cases where it couldn't send telemetry data, I'd see the point...
- pabs3 4y agoYes. It is well past time to start using application firewalls (like OpenSnitch) or VM based OSes like Qubes. https://wiki.debian.org/PrivacyIssues https://wiki.debian.org/PrivacyIssues https://www.qubes-os.org/ https://www.qubes-os.org/
- jeroenhd 4y agoOpenSnitch won't help if the dependencies you pull in come through the same server as where the tool uploads the telemetry to. Go works with a Google proxy server for this purpose by default. You can disable the Go proxy and go for a more direct source fetch with an env variable, but in the same way you can also disable the telemetry.
- pabs3 4y agoYeah, I think the only way around that would be for OpenSnitch to block all http/https requests and have a system-wide proxy that sees all the URLs, asks the user, does the approved requests and returns the results.
- api 4y agoSomehow we managed to create very high quality software before all this telemetry being larded all over every single thing. Languages like Go have enormous test code bases with unit tests to ensure that every corner of the language is compiled and executes correctly. We don't need gobs of telemetry to phone home about how people are using a compiler.
- lamontcg 4y agoThere's no guarantee that for some tests that anyone is actually using the edge case, and there's never 100% coverage. The tests are the map, the actual use of the language is the terrain. The map is assembled largely by blindly guessing what the terrain is likely to look like. That isn't very scientific. The result is a situation where users will scream at the language authors if they break something, but they'll refuse to share any information about what they're actually doing with the language, which is perverse.
- api 4y agoAbsolute nonsense. Go is an unbelievably simple straightforward language, and any mature language always has exhaustive test suites to exercise implementations of it. There are numerous compilers for C++, one of the hariest languages around, that were developed with no telemetry and work just fine and cover the entire language spec. Some of these compilers like G++ and Clang++ manage to target many different architectures with very few issues. The obsession with telemetry is a mix of laziness and I strongly suspect user-hostile surveillance motives. We're just going to have to lock down OSes. Giving any application carte blanche network access is like when apps had open access to all of system RAM and the whole filesystem back in the MS-DOS / Windows 3.x days. Maybe unauthorized (by the user) telemetry should be like invalid memory access and trigger something akin to SIGSEGV. That'll send a message.
- ModernMech 4y ago> Do i really have to treat every program as spyware and restrict its internet access ? My feeling about Google is that they do not respect privacy, no matter the product. Invasion of privacy and tracking their customers are behaviors deeply ingrained in Google DNA. Doing so for all other products has been incredibly profitable, so why not Go? It’s not like Go the language has a history of respecting the PL community (the resolution of Google stepping on the Go name was Google throwing their weight around and told the Go! author to pound sand), so why should anyone expect they respect their users?
- deafpolygon 4y agoI have said this before... this is in Google's culture and we must push back on it no matter what. It's basically the boiling pot and the frog.
- traceroute66 4y ago>By asking nicely. Not by siphoning data out of my system. THIS !!! I suspect like many people, I feel that if they had said "We're going to introduce this ... but don't worry, it will be opt-in", then they would have avoided 99.99999999999999% of the negativity. Instead, by making it opt-out, they are basically doing a classic Google shit move. And that's before we start getting into questions about GDPR and opt-out.
- jeroenhd 4y ago> Do i really have to treat every program as spyware and restrict its internet access ? If you're using an application from Google or Microsoft or any big tech company for that matter: yes. > And anyway, why would a compiler need internet access ? The go build tool will fetch dependencies for you. If you don't use dependencies or use a local network proxy instead of the Google one you can safely disable WAN access, but otherwise you'll end up with a broken tool.
- nishs 4y agoIf you wish, you can ensure that the compilation step in particular doesn't need/use the network, by first manually fetching the dependencies: someproject% go get ./... # or 'go mod download' Next disable network access for the go command, or for the whole system. Then compile: someproject% go build
- jeroenhd 4y agoThat's true. However, because of the design of go tooling, you still call the same command line method to get the tool to compile your code. This leads to the compiler having access to the internet and possibly exercising its access. In a perfect world of separated concerns the compiler binary wouldn't have any networking code at all, necessitating a go-get before calling go-build. I understand why the Golang team decided to go with this approach, but it does have side effects that people coming from different tooling (say, C) wouldn't expect.
- mindslight 4y agoSounds like a great reason to adopt Nix or the like! Run each tool in a sandbox appropriate to what it's supposed to do, and store the entirety of the inputs and outputs so they can be audited if the need arises. Nix got there via reproducibility, but it's exactly what's needed to mitigate compilers with surveillance features or other backdoors.
- oweiler 4y agoOpt-out should never be the default.