4 ms·

For being supposedly human curated, it's shocking how much garbage has infiltrated the smallweb.txt registry. I have an agent with browser access running right

For being supposedly human curated, it's shocking how much garbage has infiltrated the smallweb.txt registry. I have an agent with browser access running right now checking it and it's close to ~10%... Here's a sample of 10 examples that were found in literally the last two minutes... - "vermontdailychronicle.com" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L27927 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "ziggit.dev" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L34471 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "fastfrwrd.info" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L10771 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "evchargingstations.com" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L10534 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "escapecollective.com" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L10435 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "findingada.com" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L11376 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "fontsinuse.com" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L11530 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "fortelabs.com" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L11565 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "forum.f-droid.org" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L11570 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67... - "42zero.org" : https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67fc1ecd3d848c42d213a2e371/smallweb.txt#L1018 https://github.com/kagisearch/smallweb/blob/5aa8a7740149bd67...

freediver 7mo ago
Welcoming a PR to fix it.
- chris_money202 7mo ago
  What’s the review process for all this? It looks to only be you based on git and your HN bio. Can you get some trusted community lieutenants who can police the lists and create a file with their names ? And then anyone can raise a PR to remove or add someone to that list of lieutenants and enough approvals from community can get the PR through. I’m not super familiar with GitHub settings but sure there is a way to setup some sort of democratic process for this.
  - chris_money202 7mo ago
    Love the site btw, but I fear if you don’t get some help you’re going to trust all PRs and let them fly and trust people will issue removal PRs. For instance, my girlfriend loves the concept as well and was immediately hooked but she doesn’t know GitHub, so there’s no practical mechanism for her to remove bad content. And editing files on mobile GitHub is a pain, I probably wouldn’t even consider doing it, especially with a text file that big. So there’s going to need to be some sort of loyal community policing or voting system, because at end of day all these sites could be flipped to bad content as soon as they make it past review.
    - freediver 7mo ago
      It is a 'best effort' effort. GitHub friction is there on purpose, as it is a one man effort.

freediver 7mo ago

Welcoming a PR to fix it.

chris_money202 7mo ago
What’s the review process for all this? It looks to only be you based on git and your HN bio. Can you get some trusted community lieutenants who can police the lists and create a file with their names ? And then anyone can raise a PR to remove or add someone to that list of lieutenants and enough approvals from community can get the PR through. I’m not super familiar with GitHub settings but sure there is a way to setup some sort of democratic process for this.
- chris_money202 7mo ago
  Love the site btw, but I fear if you don’t get some help you’re going to trust all PRs and let them fly and trust people will issue removal PRs. For instance, my girlfriend loves the concept as well and was immediately hooked but she doesn’t know GitHub, so there’s no practical mechanism for her to remove bad content. And editing files on mobile GitHub is a pain, I probably wouldn’t even consider doing it, especially with a text file that big. So there’s going to need to be some sort of loyal community policing or voting system, because at end of day all these sites could be flipped to bad content as soon as they make it past review.
  - freediver 7mo ago
    It is a 'best effort' effort. GitHub friction is there on purpose, as it is a one man effort.