4 ms·
We still have tons of repositories searchable at https://sourcegraph.com/search https://sourcegraph.com/search, almost a million. We did cull lots of non-GitHub
by sqs 2y ago
We still have tons of repositories searchable at https://sourcegraph.com/search https://sourcegraph.com/search, almost a million. We did cull lots of non-GitHub repositories and repositories with less star. It was very complex to keep up with millions of repositories due to GitHub rate limits and scaling. We tried to keep as many as possible while still being able to focus on making a good product for customers (our biggest customer has ~600k repositories).
We're still spending millions of dollars annually to offer public code search, so our intent is certainly not to "destroy" it! If you have repositories you want us to add that are below the star threshold, please post at https://community.sourcegraph.com/t/most-public-repos-no-longer-accessible-via-code-search/641/2 https://community.sourcegraph.com/t/most-public-repos-no-lon....
- elashri 2y agoMost of the academic open source projects except big names in scientific computing will not be searchable if you are relying on stars as a criteria.
- cryptonector 2y agoI'd love to see mirroring to GH/GL/SH of papers' archived code and data. It would be great to have that stuff indexed. But they'll rarely have more than a few stars.
- MzHN 2y agoI appreciate that it is a free service and thank you for the time it worked for me. At the same time I am a bit sad to see my use cases break. I often resort to more advanced code search when I have really obscure problems, for which the answers might be some old GitHub (or GitLab) repositories. I'm less interested in up-to-date information for those, so a stale index is better than no index for me. But I can also feel the pain of working with GitHub and GitLab and their rate limits and such.
- IceWreck 2y ago> (our biggest customer has ~600k repositories I'm wondering what kind of company has (or needs) 600k repos.
- meepmorp 2y agoI assume that's 600k repos tracked, not necessarily owned, by the customer. Which is still a lot, but to me seemed a more likely reading.
- cryptonector 2y agoCan you make star count and participant count part of the search? `stars:>99` could be a search term to limit the search to repositories with at least 100 stars.