5 ms·

Seems like this is based on Google's own internal code search tooling, something most engineers at Google rely on for every day code-level work. I personally c

Seems like this is based on Google's own internal code search tooling, something most engineers at Google rely on for every day code-level work. I personally can't even begin to imagine how I'd navigate the gigantic codebase without it. (I work at Google)

microdrum 7y ago
You'd use Sourcegraph, probably.
- mistrial9 7y ago
  what is the constant phone-home activity on that opaque container they send as SourceGraph.. It is occassionally the case that devs have too-fast machines, so their code isn't seen on ordinary equipment. With SourceGraph and other inner-network-devs tools, the amount of chatty traffic and build dependancies seems seriously off-putting, trending to useless with ordinary network.
  - deleted 7y ago
    [deleted]
  - voz_ 7y ago
    This seems like a bad attitude. Perhaps you could constructively ask for a sourcegraph-lite that does less, in return for less deps / networking complexity?
    - slimsag 7y ago
      I am a dev at Sourcegraph, I'd be very open to any feedback. You can firewall off Sourcegraph 100% for complete confidence, and aside from the first admin's email address (so we can notify them of any security updates) we only send back aggregated anonymous usage statistics which we are extremely transparent about: https://docs.sourcegraph.com/admin/pings https://docs.sourcegraph.com/admin/pings We sell developer tools, not user data.
      - jsjddbbwj 7y ago
        Maybe the problem is that to disable telemetry you have to contact support and pray they like you, instead of giving a configuration option.
        slimsag 7y ago
        Ah, yeah, that's fair. I'll forward this feedback onto the team. The option is documented in our config docs, though, and also appears in the config editor's autocomplete in the app if you type `telemetry`, though, so it's not really a secret https://docs.sourcegraph.com/admin/config/site_config#disableNonCriticalTelemetry https://docs.sourcegraph.com/admin/config/site_config#disabl...
        prepend 7y ago
        The property is “disableNonCriticalTelemetry“ [0] that seems curiously named to me. What kind of telemetry is critical? How do I disable that? [0] https://docs.sourcegraph.com/admin/config/site_config#disableNonCriticalTelemetry https://docs.sourcegraph.com/admin/config/site_config#disabl...
        slimsag 7y ago
        You are 100% correct, I really messed up here by suggesting that option. I misread our own docs. It would only disable event counts from being sent (e.g. instead of "how many jump-to-definitions were performed in a day?" we would just send a boolean "did one or more jump-to-definition occur in a day?" based on my reading of the code[1]) -- not what I thought it did. Will send a PR to clarify the docs on this so I don't mess up like this again.. I'm human and screw up, frequently; this instance just happened to be on the ridiculously important topic of privacy -- hopefully you will forgive me for that, I wasn't trying to be malicious but certainly in retrospect I can see this being interpreted as such.. :/ The right option to turn it all off is just this one, since we only send ping data as part of the version update check you disable that and it's all off. And you can confirm this in the code as I just did here[2][3]: https://docs.sourcegraph.com/admin/config/site_config#update-channel https://docs.sourcegraph.com/admin/config/site_config#update... And as I mentioned previously you can always firewall off Sourcegraph 100%. As an aside, I can promise you that I wouldn't have continued to work at Sourcegraph for the last 5 years if I thought our business was selling or collecting identifiable user data in ANY form. We only collect just enough information to help prioritize what features we improve and (aside from the first admin's email as I noted already above) it is all 100% anonymous and aggregated numbers that we are extremely transparent about[4]. Our person running analytics is also constantly trying to make this more transparent[5] because we all are very security and privacy aware and know the #1 way to convince people to not run software is to make them think you are spying on them or using their data in ways they would not want. It's obvious to me this should be more clear in our docs, I'm going to forward all of this conversation onto the rest of our team to make sure we improve our docs here. [1] https://sourcegraph.com/search?q=repo:%5Egithub%5C.com/sourcegraph/sourcegraph%24+disableNonCriticalTelemetry&patternType=literal https://sourcegraph.com/search?q=repo:%5Egithub%5C.com/sourc... [2] https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f86cfd11cff21360d1c2c4563aec32f38d56a5ae/-/blob/cmd/frontend/internal/app/pkg/updatecheck/client.go#L308-310 https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f... [3] https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f86cfd11cff21360d1c2c4563aec32f38d56a5ae/-/blob/cmd/frontend/internal/app/pkg/updatecheck/client.go#L195-213 https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f... [4] https://docs.sourcegraph.com/admin/pings https://docs.sourcegraph.com/admin/pings [5] https://github.com/sourcegraph/sourcegraph/pull/8930#issuecomment-598277859 https://github.com/sourcegraph/sourcegraph/pull/8930#issueco...
arunaugustine 7y ago
Would you know if the Google cloud product for hosting git projects [1] uses the same underlying code search as the internal tool? [1] https://cloud.google.com/source-repositories https://cloud.google.com/source-repositories
- hanwenn 7y ago
  It is the same tool.
  - snazz 7y ago
    It’s also used for https://source.chromium.org https://source.chromium.org. I now host my monorepo on Cloud Source Repositories because it has a super nice integration with the rest of their products.
enriquto 7y ago
How long do you estimate we will be able to use this before google inevitably kills the project?
joatmon-snoo 7y ago
If you crack open developer tools and watch the API requests go by, you'll be able to confirm that it's the same thing :)
- cromwellian 7y ago
  Not really, this is a pale shadow of what the real CodeSearch inside Google does. I really wish the external ones had even 1/10th the functionality.
  - coderdd 7y ago
    Help https://github.com/TreeTide/underhood https://github.com/TreeTide/underhood reach feature parity ;)
  - zxienin 7y ago
    what's 9/10th that internal one has?
deleted 7y ago
[deleted]
wrsh07 7y ago
I had this same fear as I left Google, but it turns out that a great ide (eg anything by jetbrains) can take you quite far. It's a different work flow, but you simply don't need cs/ when your code base is orders of magnitude smaller

microdrum 7y ago

You'd use Sourcegraph, probably.

mistrial9 7y ago
what is the constant phone-home activity on that opaque container they send as SourceGraph.. It is occassionally the case that devs have too-fast machines, so their code isn't seen on ordinary equipment. With SourceGraph and other inner-network-devs tools, the amount of chatty traffic and build dependancies seems seriously off-putting, trending to useless with ordinary network.
- deleted 7y ago
  [deleted]
- voz_ 7y ago
  This seems like a bad attitude. Perhaps you could constructively ask for a sourcegraph-lite that does less, in return for less deps / networking complexity?
  - slimsag 7y ago
    I am a dev at Sourcegraph, I'd be very open to any feedback. You can firewall off Sourcegraph 100% for complete confidence, and aside from the first admin's email address (so we can notify them of any security updates) we only send back aggregated anonymous usage statistics which we are extremely transparent about: https://docs.sourcegraph.com/admin/pings https://docs.sourcegraph.com/admin/pings We sell developer tools, not user data.
    - jsjddbbwj 7y ago
      Maybe the problem is that to disable telemetry you have to contact support and pray they like you, instead of giving a configuration option.
      - slimsag 7y ago
        Ah, yeah, that's fair. I'll forward this feedback onto the team. The option is documented in our config docs, though, and also appears in the config editor's autocomplete in the app if you type `telemetry`, though, so it's not really a secret https://docs.sourcegraph.com/admin/config/site_config#disableNonCriticalTelemetry https://docs.sourcegraph.com/admin/config/site_config#disabl...
        prepend 7y ago
        The property is “disableNonCriticalTelemetry“ [0] that seems curiously named to me. What kind of telemetry is critical? How do I disable that? [0] https://docs.sourcegraph.com/admin/config/site_config#disableNonCriticalTelemetry https://docs.sourcegraph.com/admin/config/site_config#disabl...
        slimsag 7y ago
        You are 100% correct, I really messed up here by suggesting that option. I misread our own docs. It would only disable event counts from being sent (e.g. instead of "how many jump-to-definitions were performed in a day?" we would just send a boolean "did one or more jump-to-definition occur in a day?" based on my reading of the code[1]) -- not what I thought it did. Will send a PR to clarify the docs on this so I don't mess up like this again.. I'm human and screw up, frequently; this instance just happened to be on the ridiculously important topic of privacy -- hopefully you will forgive me for that, I wasn't trying to be malicious but certainly in retrospect I can see this being interpreted as such.. :/ The right option to turn it all off is just this one, since we only send ping data as part of the version update check you disable that and it's all off. And you can confirm this in the code as I just did here[2][3]: https://docs.sourcegraph.com/admin/config/site_config#update-channel https://docs.sourcegraph.com/admin/config/site_config#update... And as I mentioned previously you can always firewall off Sourcegraph 100%. As an aside, I can promise you that I wouldn't have continued to work at Sourcegraph for the last 5 years if I thought our business was selling or collecting identifiable user data in ANY form. We only collect just enough information to help prioritize what features we improve and (aside from the first admin's email as I noted already above) it is all 100% anonymous and aggregated numbers that we are extremely transparent about[4]. Our person running analytics is also constantly trying to make this more transparent[5] because we all are very security and privacy aware and know the #1 way to convince people to not run software is to make them think you are spying on them or using their data in ways they would not want. It's obvious to me this should be more clear in our docs, I'm going to forward all of this conversation onto the rest of our team to make sure we improve our docs here. [1] https://sourcegraph.com/search?q=repo:%5Egithub%5C.com/sourcegraph/sourcegraph%24+disableNonCriticalTelemetry&patternType=literal https://sourcegraph.com/search?q=repo:%5Egithub%5C.com/sourc... [2] https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f86cfd11cff21360d1c2c4563aec32f38d56a5ae/-/blob/cmd/frontend/internal/app/pkg/updatecheck/client.go#L308-310 https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f... [3] https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f86cfd11cff21360d1c2c4563aec32f38d56a5ae/-/blob/cmd/frontend/internal/app/pkg/updatecheck/client.go#L195-213 https://sourcegraph.com/github.com/sourcegraph/sourcegraph@f... [4] https://docs.sourcegraph.com/admin/pings https://docs.sourcegraph.com/admin/pings [5] https://github.com/sourcegraph/sourcegraph/pull/8930#issuecomment-598277859 https://github.com/sourcegraph/sourcegraph/pull/8930#issueco...

arunaugustine 7y ago

Would you know if the Google cloud product for hosting git projects [1] uses the same underlying code search as the internal tool? [1] https://cloud.google.com/source-repositories https://cloud.google.com/source-repositories

hanwenn 7y ago
It is the same tool.
- snazz 7y ago
  It’s also used for https://source.chromium.org https://source.chromium.org. I now host my monorepo on Cloud Source Repositories because it has a super nice integration with the rest of their products.

enriquto 7y ago

How long do you estimate we will be able to use this before google inevitably kills the project?

joatmon-snoo 7y ago

If you crack open developer tools and watch the API requests go by, you'll be able to confirm that it's the same thing :)

cromwellian 7y ago
Not really, this is a pale shadow of what the real CodeSearch inside Google does. I really wish the external ones had even 1/10th the functionality.
- coderdd 7y ago
  Help https://github.com/TreeTide/underhood https://github.com/TreeTide/underhood reach feature parity ;)
- zxienin 7y ago
  what's 9/10th that internal one has?

deleted 7y ago

[deleted]

wrsh07 7y ago

I had this same fear as I left Google, but it turns out that a great ide (eg anything by jetbrains) can take you quite far. It's a different work flow, but you simply don't need cs/ when your code base is orders of magnitude smaller