4 ms·
Nice! You might be alyso interested to know that PyPI download stats are also available in BigQuery: https://mail.python.org/pipermail/distutils-sig/2016-May/
by fhoffa 10y ago
Nice!
You might be alyso interested to know that PyPI download stats are also available in BigQuery:
https://mail.python.org/pipermail/distutils-sig/2016-May/028986.html https://mail.python.org/pipermail/distutils-sig/2016-May/028...
(project recently unveiled by Donald Stufft)
I also added your article to the compilation at https://medium.com/@hoffa/github-on-bigquery-analyze-all-the-code-b3576fd2b150 https://medium.com/@hoffa/github-on-bigquery-analyze-all-the..., thanks for your prolific series of analysis!
- kozikow 10y agoThanks! I will join this data with pypi stats.
- stared 10y agoIs there any way to combine downloads for a single user? I.e. to know that the pip downloaded both package X and package Y?
- kozikow 10y ago99% chance that it's not possible and it won't be possible soon. You can take a look at the table at https://bigquery.cloud.google.com/table/the-psf:pypi.downloads20160711 https://bigquery.cloud.google.com/table/the-psf:pypi.downloa... and check out tabs "Schema" and "Preview". Mix of country_code, details* and tls* could give you "rough" grouping, but there would probably be 100s of users in the same bucket. It is probably designed in a way to not let you target single user that way. It's likely that there is a pipeline scrubbing small buckets to avoid privacy leaks. I had to write pipelines like this myself on different datasets.