3 ms·
Well really, open source doesn't mean anything in the context of a Website. So what if you have the source code Google uses to run their query engine, crawlers
by bobajeff 11y ago
Well really, open source doesn't mean anything in the context of a Website. So what if you have the source code Google uses to run their query engine, crawlers and index if you dint have all of their data. The same applies to facebook.
The Open Data movement is more applicable here. With that in mind there is Common Crawl and Open Street Maps.
The thing about collecting data out of good will or for some nonprofit mission is that you have different standards, motivations and methods for connecting data than for public for-profit corporations. Some data should not be collected, at least without permission. Privacy and copyrights are issues Google and Facebook deal with after the fact not before they collect the data.