11 ms·
Map of GitHub
- neonate 2y agoLive link: https://anvaka.github.io/map-of-github/ https://anvaka.github.io/map-of-github/
- stevage 2y agoYeah, this should be the link - not the repo.
- lizmutton 2y agoThis is phenomenal!
- Weetile 2y ago"Sussex" as the name of the Among Us section had me laughing
- throwaway127482 2y agoThe funniest one I saw was "Lispaña"
- HellsMaddy 2y agoHow are connections between repos determined? I checked some of my repos and don't see any references in either direction for some of the connections.
- frereubu 2y agoIn the first line: "Dots are close to each other if they have a lot of common stargazers."
- HellsMaddy 2y agoThat explains why they are "close to each other" but not what determines which nodes are connected by an edge.
- tux3 2y agoI think it's the other way around. The similarity metric determines which repos have edges (possibly weighted?) And then some clustering algorithm makes sense of this giant graph by laying out sets of nodes that have a lot of edges to each other, close to each other The closeness is just layout, the edges is the data structure that determines closeness.
- anvaka 2y agoThis is correct!
- minimaxir 2y agoJaccard similarity returns a value between 0 and 1 (in this case the vast majority of the values being close to 0). I suspect there's a hard-coded threshold value to determine an edge, e.g. if Jaccard similarity between A and B is > 0.2, create an edge.
- pierrec 2y agoThe author answered that question in the original HN post: https://news.ycombinator.com/item?id=35933981 https://news.ycombinator.com/item?id=35933981 Basically what others are guessing, lines represent the highest similarity scores based on "stargazers", which also forms the entire map. To anyone confused, the lines only appear once you click into a specific country.
- HPsquared 2y ago"The GitHub Archipelago"
- huevosabio 2y agoSurprised at how small Rustland is. Barely a province in Clouderra. Also, interesting how both Bevy and Veloren are in Rustland. Probably, the stars come more from the Rust community than the game dev community. Which I guess makes sense: the Rust ecosystem is still relatively small and feels like a lot of people doing X but in Rust.
- huevosabio 2y agoAlso, lol at Zig being a suburb of Rust
- ramon156 2y agoHappy to see bevy between them though! :)
- huevosabio 2y agoTangent: not that often to see a fellow Ramon in hn :)
- culi 2y agoI'm also shocked how small "nodelandia" is and that its not even its own continent. I guess we all overestimate the size of our bubbles
- robertclaus 2y agoI've been thinking something similar for identifying ownership areas within an organization would be cool.
- bushbaba 2y agoInteresting that azureland is under l33t nation and not clouderia
- tux3 2y agoSomehow torvalds/linux is in Fronterra, next to JS projects, awesome-X lists, and frontend checklists. Either kernel hackers unexpectedly love frontend, or more likely the people that write the code don't overlap much with the people that star Github projects!
- revskill 2y agoBecause of react ?
- jensenbox 2y agoThat was my first reaction.
- moffkalast 2y agoWhat's your angle?
- dbrans 2y agoCan you elaborate?
- odo1242 2y agoWait, why React?
- dataviz1000 2y agoPerhaps the same reason heat maps are often really the underlining population map https://xkcd.com/1138/ https://xkcd.com/1138/
- wodenokoto 2y agoThat’s why in NLP we use term frequency over inverse document frequency. It gives you a measure of common uncommon things are. Wonder how you’d implement that in a heat map. Just call each pixel a document and see where it takes you?
- jamala1 2y agoVery neat and creative approach but I'm honestly conflicted whether the country/map metaphor is the best choice. In many cases the names are not that clear, so one has to zoom in to understand what they represent. It would perhaps be more interesting to do hierarchical clustering and show something like average connectiveness between the (super)clusters with lines, possibly with more descriptive/faithful LLM-generated labels for each cluster.
- romanobro56 2y agoThey could have done that, but they decided to do a map
- richardw 2y agoI was pleasantly surprised that it wasn’t a heavy line drawing creation. As someone who first did those in the 90’s and almost immediately learned their limits, I think this is nice because it doesn’t overclaim. It’s just a view, not a thesis. I like diagrams where the axes mean something. Lines, shape, boxes/groups, distance, X vs Y, colour, thickness, texture, background, foreground. I also like simple. So often it’s lines to be fancy with no meaning. This one is just a pic, with some grouping, and it has personality. Yay? (Still love lines, just not everywhere always.)
- anvaka 2y agoI couldn't find a universal clustering algorithm yet: Frequently there is more than one way to group data that still makes sense, and as a result whichever final clustering option we choose - it will not be perfect. Hm... unless maybe we do some sort of quantum clustering, which could be a fun project to explore! It's a bit hazy now, but I remember trying hdbscan algorithm (hierarchical clustering), and on the graph of the GitHub size - I just couldn't fit it in memory. I did end up using something similar to hierarchical clustering (mix of louvain/leiden/my own), and that's what we see in the final map.
- labster 2y agoWikimedia is right next to GPT Nation. I think an invasion is imminent.
- cisrockandroll 2y agoFORTRAN and COBOL Programming is a part of the AI island, lol.
- Jimmc414 2y agoFortran has been given new life https://arxiv.org/search/?query=fortran&searchtype=all&source=header https://arxiv.org/search/?query=fortran&searchtype=all&sourc... https://github.com/search?q=fortran+language%3AFortran+neural&type=repositories&s=updated&o=desc https://github.com/search?q=fortran+language%3AFortran+neura...
- heeton 2y agoLispaña is a really excellent name for a lisp country :)
- anvaka 2y agoThank you =)
- Kylejeong21 2y agocouldn't find any of my stuff so that means i gotta do more lol
- ALOHa100 2y agoyay anvaka reaches front page! fun times from reddit map
- anvaka 2y agohaha thank you!
- malux85 2y agoI'm not sure why BinanceLand is in AILandia though, please dont encourage them XD
- ChrisArchitect 2y agoSome previous discussion: 2023 https://news.ycombinator.com/item?id=35931402 https://news.ycombinator.com/item?id=35931402
- est 2y agoZH.Pyscrapia had an island of its own.
- acmeian 2y agoA fun minigame is trying to find a particular project using the map only, without the search feature :-)
- huevosabio 2y agoor start with one project and find your way to another, you can imagine there are shipping lines :)
- anvaka 2y agolove it =)!
- Havoc 2y ago> Homelabia Definitely some unique naming choices there lol
- shlomo_z 2y agoThis is truly a work of art! Great job!
- H2HOE 2y agoWhy was jaccard similarity preferred here i would love to learn more about the choice process. Fantastic Work though love it
- anvaka 2y agoThank you! I tried quite a few various similarity metrics, and Jaccard was giving me the best results. This is all very subjective, of course.
- matt_trentini 2y agoCool visualisation! It was somewhat amusing that MicroPython isn't in MicroPythonia but Arduinoria...and CircuitPython is in PicoPythonia. :)
- boxed 2y agoDjango is in the middle of Pythonia, and not in Djangonia. Weird!
- throwaway93t32 2y agoIt's similar to how SpringBootia is almost as big as Javaland, but Spring Boot itself is in Javaland and not it's "homeland"
- philipwhiuk 2y agoIf you develop on Linux you generally probably don't star linux/kernel. But you do star other projects developing on Linux. Ditto if you develop Django, you star Python libraries, not Django downstream plugins.
- fzeindl 2y agoI do have the theory that the more untyped the language is, the larger the islands are: Fronterra (JavaScript), Cloudderra (YAML), AILandia (Python) are way bigger than Java, Swift, DotNet, etc. even though the prejudice saying goes that the problem of software engineering is stale old enterprise code in Java/DotNet. That might be the case, but the libraries seems to be more reusable!
- brabel 2y agoJavascript made the barrier to entry for creating a package nearly zero. In contrast, it's fairly difficult to publish something on Maven Central (the main Java repository). You need to prove you own a domain, setup a GPG key for signing, manually register with Sonatype, which is more than many people are willing to do. I think that explains it much better.
- jrgv 2y agoThe stale old enterprise code is not in public repositories.
- LtWorf 2y agoBut stargazers are absolutely meaningless, since most of them are bots that give stars behind payment and like random stuff to throw off detection. And as usual important libraries don't get as much attention as flash little leaf projects.
- Mustachio 2y agodocker-minecraft is under Adulttopia. I wonder what made it make that connection
- k__ 2y agoLooks like AI is already trashing the place, lol.
- uwemaurer 2y agothis looks really great! I tried something similar a few weeks ago, using the embedding vectors of the Github project descriptions. https://awesome.facts.dev/3d https://awesome.facts.dev/3d
- rcarmo 2y agoNice, but kind of weird to find piku/Piku in Fronterra.
- VMG 2y agoVery well done, loads quickly and is usable even from mobile. I love this sort of concept map and I am typically disappointed by the execution.
- hatmatrix 2y agoAs a fan of Julia, surprised to see how julialang/julia has so few links. It's a niche language; how isolated it is on this map is maybe not so unrepresentative of the user or developer experience.
- sundarurfriend 2y agoThere's a JuliaLand to the west of the island where julialang/julia is. The fact that julialang/julia ended up near tensorflow and opencv, and actual Julia packages ended up elsewhere, probably reflects a difference between aspirational users and real users: a lot of people who starred the Julia project itself were numeric Python users who were looking for a new Python, but then mostly stuck to Python itself, so their other stars are in the numeric Python land. Those who starred the JuliaLand packages are the actual Julia users who aptly enough ended up near Moleculandia and AstroSpace and Quantumia.
- hatmatrix 2y agoAh I didn't see that. That explanation sounds very plausible.
- gudzpoz 2y agoQuitlessia and NeoQuitlessia... These names are evil. (Doom Emacs lies in NeoQuitlessia instead of Emacsia, which surprisingly makes sense. :)
- anvaka 2y agohaha! I love vim. We shall not quit.
- stevage 2y agoVery fun to be able to find my own project there (mapbox-gl-utils): https://anvaka.github.io/map-of-github/#12/24.78947/18.85186 https://anvaka.github.io/map-of-github/#12/24.78947/18.85186
- openrisk 2y agoIts good to see all those "why is X in Y?" type comments. Remember that feeling when deploying algorithms, especially when those affect people (which hopefully in not the case with this nice project. A mechanism to explain how specific results came about is as much part of the project as the more technical machine learning choices involved.
- djoldman 2y ago> In the second phase I computed exact Jaccard Similarity between each repository. Using what inputs? The repo seems to have only the frontend code.
- philipwhiuk 2y agoThe star data from the first phase.
- 71bw 2y agoInteresting how one fork of Magisk lands in "AndroModLand" and another in some gaming space.
- hirako2000 2y agoThe author of this also made other outstanding vizualisations. A while back ngraph blew my mind. I built a taxonomy biz off ngraph: https://hirako-ngraph.surge.sh/#/world/nature https://hirako-ngraph.surge.sh/#/world/nature
- anvaka 2y agoThank you for your kind words! That link you've shared - doesn't open for some reason
- ristomatti 2y agoIt did for me now, perhaps too much traffic. It's pretty wild, especially on a tablet due to the gyroscope effect!
- hirako2000 2y agoGyro support is also Andrei's work, not mine. I found the (awesome) video where he presents ngraph: https://youtu.be/vZ6Yhlxv7Os https://youtu.be/vZ6Yhlxv7Os Edit: not loading? surge.sh has been less reliable lately, will get to finish that project some day and will publish elsewhere.
- shayansm1 2y agoSome might say that PHP is dead (and I’d be one of them too), but there is a PHP kingdom on the map! :) I think we might have all been mistaken.
- dmd 2y agoI don't think anyone has ever seriously suggested PHP is dead. People may want it to be dead, but it's probably still the most-used language on the web!
- 9dev 2y agoSorry, not sorry—PHP is alive, and thriving! The language runtime is getting ever faster, the packagist ecosystem in combination with composer (PHP's package manager) are rock-solid, there are event loops and application servers by now, serverless deployments are the default operation mode, and with Laravel or Symfony, there are trusted and extremely versatile frameworks available that do stuff out of the box that require lots of manual efforts with other languages. Add to that the support for type annotations that can go all the way from fully untyped and dynamic, to runtime-enforced primitive constraints and object types, and you'll end up with a very good choice for web applications that evolve quickly.
- romanroe 2y agoVery interesting that HTMX (bigskysoftware/htmx), which is backend-agnostic, lives in Pythonia->Djangonia and not in e.g. Fronterra. Does this mean that HTMX is mostly used by Django devs?
- nasso_dev 2y agoDespite HTMX being backend-agnostic, I heard it pairs extremely well with Django, so that's probably why! Maybe the two are particularly well fitting pieces of the web dev puzzle.
- romanroe 2y agoI love Django and its my primary weapon of choice. But due to its structure and philosophy it doesn't move as fast as e.g. Rails (e.g. impressive how quickly they picked up SQLite for their Solid* stuff). I guess HTMX was a very welcomed solution from the "outside" to allow more interactive frontends.
- jamalaramala 2y agoKudos to the author for the amazing idea! The only problem I see is that projects don't fit so nicely in the division between languages (Pythonia, Javaland, Clojuria, etc) and applications (Gamedonia, AILandia, etc). There's a lot of intersection between them. But the visualization is super-cool nonetheless. :)
- buryat 2y ago"Stop the war" looks like a very small territory, you don't even need to think what kind of message they send. It's so small in the grand scheme
- robblbobbl 2y agoCool
- oystermax 2y ago[dead]