4 ms·

Stargazers intersections for most popular GitHub projects in Venn diagrams

31 points by ashvardanian 3y ago

smlacy 3y ago
https://nitter.net/ashvardanian/status/1723393012728758565 https://nitter.net/ashvardanian/status/1723393012728758565
mparnisari 3y ago
Very cool! Where is the script? Can't find it
- zX41ZdbW 3y ago
  This: https://play.clickhouse.com/play?user=play#U0VMRUNUIGJpbihzZWdtZW50cyksIGNvdW50KCkKRlJPTQooCldJVEgKICAgIHJlcG9fbmFtZSBJTiAoJ0NsaWNrSG91c2UvQ2xpY2tIb3VzZScsICd5YW5kZXgvQ2xpY2tIb3VzZScpIEFTIHNlZ21lbnQxLAogICAgcmVwb19uYW1lIElOICgncmVkaXMvcmVkaXMnLCAnYW50aXJlei9yZWRpcycpIEFTIHNlZ21lbnQyLAogICAgcmVwb19uYW1lIElOICgnbW9uZ29kYi9tb25nbycpIEFTIHNlZ21lbnQzLAogICAgc2VnbWVudDEgT1Igc2VnbWVudDIgT1Igc2VnbWVudDMgQVMgdG90YWwKU0VMRUNUIGFjdG9yX2xvZ2luLCBtYXgoc2VnbWVudDEpICsgbWF4KHNlZ21lbnQyKSAqIDIgKyBtYXgoc2VnbWVudDMpICogNCBBUyBzZWdtZW50cwpGUk9NIGdpdGh1Yl9ldmVudHMgV0hFUkUgZXZlbnRfdHlwZSA9ICdXYXRjaEV2ZW50JyBBTkQgdG90YWwgR1JPVVAgQlkgQUxMCikKR1JPVVAgQlkgc2VnbWVudHMKT1JERVIgQlkgYml0Q291bnQoc2VnbWVudHMpLCBzZWdtZW50cw== https://play.clickhouse.com/play?user=play#U0VMRUNUIGJpbihzZ...
- ashvardanian 3y ago
  It’s on my GitHub, mentioned in a preceding tweet: https://gist.github.com/ashvardanian/76bae6147fe5581176529399ac0cb6bd https://gist.github.com/ashvardanian/76bae6147fe558117652939...
nerdponx 3y ago
> There should be more overlap between NetworkX and NumPy, than with Pandas, esp among Spectral Graph Theory practicioners Sounds partly like sampling bias to me. I do not at all think it's safe to assume that GitHub users that star libraries actively is a representative random sample of all users of those libraries. But it also sounds like a misunderstanding of just how many people think of "Numpy + Pandas" together as forming the foundations of the data analysis and data processing toolkit in Python. Almost every project where I use the latter, I end up importing the former for some reason or other, even if I'm not doing anything heavily numerical or computational.
cryptoboy2283 3y ago
Great. Now what?
butz 3y ago
I would assume this might been inspired by a talk given by Anthony Fu on ViteConf '23 - "Anthony's Road to Open Source: The Set Theory" https://www.youtube.com/watch?v=NJbCfAKtxUI https://www.youtube.com/watch?v=NJbCfAKtxUI ?
- ashvardanian 3y ago
  Haven’t seen that, thanks for sharing! I was thinking about implementing a set-search and clustering of similar nature here: https://ashvardanian.com/posts/abusing-vector-search/ https://ashvardanian.com/posts/abusing-vector-search/
zX41ZdbW 3y ago
Another interesting thing - find friends on GitHub using the intersection between stars you've gave: https://ghe.clickhouse.tech/#finding-friends-through-counting-stars https://ghe.clickhouse.tech/#finding-friends-through-countin...
- gavinray 3y ago
  Super cool! Can I run this on a public instance somewhere?
  - ashvardanian 3y ago
    It shouldn’t be hard to implement: https://ghe.clickhouse.tech/#how-to-download-the-data https://ghe.clickhouse.tech/#how-to-download-the-data
  - zX41ZdbW 3y ago
    It is already the public instance: https://play.clickhouse.com/play?user=play https://play.clickhouse.com/play?user=play

31 points by ashvardanian 3y ago

smlacy 3y ago

https://nitter.net/ashvardanian/status/1723393012728758565 https://nitter.net/ashvardanian/status/1723393012728758565

mparnisari 3y ago

Very cool! Where is the script? Can't find it

zX41ZdbW 3y ago
This: https://play.clickhouse.com/play?user=play#U0VMRUNUIGJpbihzZWdtZW50cyksIGNvdW50KCkKRlJPTQooCldJVEgKICAgIHJlcG9fbmFtZSBJTiAoJ0NsaWNrSG91c2UvQ2xpY2tIb3VzZScsICd5YW5kZXgvQ2xpY2tIb3VzZScpIEFTIHNlZ21lbnQxLAogICAgcmVwb19uYW1lIElOICgncmVkaXMvcmVkaXMnLCAnYW50aXJlei9yZWRpcycpIEFTIHNlZ21lbnQyLAogICAgcmVwb19uYW1lIElOICgnbW9uZ29kYi9tb25nbycpIEFTIHNlZ21lbnQzLAogICAgc2VnbWVudDEgT1Igc2VnbWVudDIgT1Igc2VnbWVudDMgQVMgdG90YWwKU0VMRUNUIGFjdG9yX2xvZ2luLCBtYXgoc2VnbWVudDEpICsgbWF4KHNlZ21lbnQyKSAqIDIgKyBtYXgoc2VnbWVudDMpICogNCBBUyBzZWdtZW50cwpGUk9NIGdpdGh1Yl9ldmVudHMgV0hFUkUgZXZlbnRfdHlwZSA9ICdXYXRjaEV2ZW50JyBBTkQgdG90YWwgR1JPVVAgQlkgQUxMCikKR1JPVVAgQlkgc2VnbWVudHMKT1JERVIgQlkgYml0Q291bnQoc2VnbWVudHMpLCBzZWdtZW50cw== https://play.clickhouse.com/play?user=play#U0VMRUNUIGJpbihzZ...
ashvardanian 3y ago
It’s on my GitHub, mentioned in a preceding tweet: https://gist.github.com/ashvardanian/76bae6147fe5581176529399ac0cb6bd https://gist.github.com/ashvardanian/76bae6147fe558117652939...

nerdponx 3y ago

> There should be more overlap between NetworkX and NumPy, than with Pandas, esp among Spectral Graph Theory practicioners Sounds partly like sampling bias to me. I do not at all think it's safe to assume that GitHub users that star libraries actively is a representative random sample of all users of those libraries. But it also sounds like a misunderstanding of just how many people think of "Numpy + Pandas" together as forming the foundations of the data analysis and data processing toolkit in Python. Almost every project where I use the latter, I end up importing the former for some reason or other, even if I'm not doing anything heavily numerical or computational.

cryptoboy2283 3y ago

Great. Now what?

butz 3y ago

I would assume this might been inspired by a talk given by Anthony Fu on ViteConf '23 - "Anthony's Road to Open Source: The Set Theory" https://www.youtube.com/watch?v=NJbCfAKtxUI https://www.youtube.com/watch?v=NJbCfAKtxUI ?

ashvardanian 3y ago
Haven’t seen that, thanks for sharing! I was thinking about implementing a set-search and clustering of similar nature here: https://ashvardanian.com/posts/abusing-vector-search/ https://ashvardanian.com/posts/abusing-vector-search/

zX41ZdbW 3y ago

Another interesting thing - find friends on GitHub using the intersection between stars you've gave: https://ghe.clickhouse.tech/#finding-friends-through-counting-stars https://ghe.clickhouse.tech/#finding-friends-through-countin...

gavinray 3y ago
Super cool! Can I run this on a public instance somewhere?
- ashvardanian 3y ago
  It shouldn’t be hard to implement: https://ghe.clickhouse.tech/#how-to-download-the-data https://ghe.clickhouse.tech/#how-to-download-the-data
- zX41ZdbW 3y ago
  It is already the public instance: https://play.clickhouse.com/play?user=play https://play.clickhouse.com/play?user=play