I suspect the problem is that Google can't fully crawl stackoverflow/github etc. How is this possible, given their insane resources and expertise? If they can'

I suspect the problem is that Google can't fully crawl stackoverflow/github etc. How is this possible, given their insane resources and expertise? If they can't crawl fast enough, can't they simply make a deal with Microsoft to get the public data from Github the moment it is created? I assume they have similar deals with other companies (Twitter maybe? for their firehose?). This particular thing doesn't seem to be a tech limitation. Most likely Google doesn't care enough to fix the issue, they could probably fix it in a week if they wanted to. At this point, nothing is going to improve until a serious competitor to Google comes along. And I don't see that happening anytime soon, so all the issues that users have with Google are likely going to stay.