3 ms·
Works for me! Cool project! I really like the "Comparisons" page with brief info about the repos. Does it crawl all of GitHub to find repos with similar names
by jspann 5y ago
Works for me! Cool project!
I really like the "Comparisons" page with brief info about the repos.
Does it crawl all of GitHub to find repos with similar names or only stick to the popular repos that were already indexed? Also how does it rank the alternatives that it finds? For example on https://www.libhunt.com/bitcoin/bitcoin https://www.libhunt.com/bitcoin/bitcoin , why is umbrel above dogecoin or bitcoin book?
- stanislavb 5y agoThanks, mate! It crawls only projects mentioned on Reddit, Hacker News and Dev.to.
- ronyfadel 5y agoCrawling noob here: what's a good strategy to crawl these websites? Reddit is huge, how does one efficiently crawl it? Search API for Github links?
- stanislavb 5y agoI've built a custom engine to achieve that (Elixir/Phoenix). It uses a simplified version of the Aho–Corasick algorithm https://en.wikipedia.org/wiki/Aho%E2%80%93Corasick_algorithm https://en.wikipedia.org/wiki/Aho%E2%80%93Corasick_algorithm to match all mentions of subscribed keywords/URLs. I use the same engine for SaaSHub, too.
- jspann 5y agoI see. Nice work!
- stanislavb 5y agoCheers! Work appreciation here on HN is highly appreciated. (as that could be a rare beast)