4 ms·

I want a search engine that deprioritizes results based on the number of trackers or ads on the page. Like, rank = (relevance * 1.0) + (trackers * -0.5) + (ads

by floren 8y ago

I want a search engine that deprioritizes results based on the number of trackers or ads on the page. Like, rank = (relevance * 1.0) + (trackers * -0.5) + (ads * -0.5).

talkingtab 8y ago
A brilliant idea! I'm in if anyone want talks about how to do this. Whats the best way to host a discussion? Slack/github/other?
- ravenstine 8y ago
  I think Github would get higher visibility, and there also wouldn't be a limit on comment history.
  - talkingtab 8y ago
    I set up a github thing if anyone is interested. https://github.com/talkingtab/no-track-web https://github.com/talkingtab/no-track-web
headgasket 8y ago
That's an awesome idea; which leads me to think, what would be needed to experiment with alternative page ranks and levels of bubble-encapsulation? What resources are out there from which one could experiment-- as crawling the whole web is too large of an endeavour? How about a distributed database of the text-internet that anyone could clone and build indexes from? A layered approach? This must surely already exist?
- ss2003 8y ago
  You don't need to crawl the web yourself. http://commoncrawl.org/ http://commoncrawl.org/ will give you the data for free. It's a little out of date by the time you get it but that shouldn't effect a project like this.
- deleted 8y ago
  [deleted]
- Torwald 8y ago
  You could build another Google, why not?
solarkraft 8y ago
I wish DuckDuckGo had some better filtering features like this.
ksangeelee 8y ago
I made an attempt to do something a bit like this this by a) seeding from HN links and, b) passing all links through uBlock Origin via Puppeteer. My assumption is that more uBlock hits correlates with lower quality (a crude metric, I know, but turns out not far off the mark) My first-run result is here http://kakapo.susa.net:8080/cfs/ http://kakapo.susa.net:8080/cfs/ - I think the results are promising, even on a tiny index (around 1M pages, I think).
pmart123 8y ago
I really like this in concept.

by floren 8y ago

I want a search engine that deprioritizes results based on the number of trackers or ads on the page. Like, rank = (relevance * 1.0) + (trackers * -0.5) + (ads * -0.5).

talkingtab 8y ago

A brilliant idea! I'm in if anyone want talks about how to do this. Whats the best way to host a discussion? Slack/github/other?

ravenstine 8y ago
I think Github would get higher visibility, and there also wouldn't be a limit on comment history.
- talkingtab 8y ago
  I set up a github thing if anyone is interested. https://github.com/talkingtab/no-track-web https://github.com/talkingtab/no-track-web

headgasket 8y ago

That's an awesome idea; which leads me to think, what would be needed to experiment with alternative page ranks and levels of bubble-encapsulation? What resources are out there from which one could experiment-- as crawling the whole web is too large of an endeavour? How about a distributed database of the text-internet that anyone could clone and build indexes from? A layered approach? This must surely already exist?

ss2003 8y ago
You don't need to crawl the web yourself. http://commoncrawl.org/ http://commoncrawl.org/ will give you the data for free. It's a little out of date by the time you get it but that shouldn't effect a project like this.
deleted 8y ago
[deleted]
Torwald 8y ago
You could build another Google, why not?

solarkraft 8y ago

I wish DuckDuckGo had some better filtering features like this.

ksangeelee 8y ago

I made an attempt to do something a bit like this this by a) seeding from HN links and, b) passing all links through uBlock Origin via Puppeteer. My assumption is that more uBlock hits correlates with lower quality (a crude metric, I know, but turns out not far off the mark) My first-run result is here http://kakapo.susa.net:8080/cfs/ http://kakapo.susa.net:8080/cfs/ - I think the results are promising, even on a tiny index (around 1M pages, I think).

pmart123 8y ago

I really like this in concept.