3 ms·

Sort of hijacking the thread to ask, can YaCy or similar, be an alternative to Google's Programmable Search Engine? All I use it for is limit a search to a medi

Sort of hijacking the thread to ask, can YaCy or similar, be an alternative to Google's Programmable Search Engine? All I use it for is limit a search to a medium-sized list of domains. The aspect that makes running a search engine difficult on your own is lack of resources for crawling, I expect. But since I only care about a small list of domains, could I ditch Google's and run my own crawler like YaCy?

gtirloni 3y ago
Is that the deceased code search tool? You could run Sourcegraph and import/sync those repositories. Or you could run your own ElasticSearch/Melisearch and crawl the websites yourself (if you're interested in things other than git repositories).
- arboles 3y ago
  > Is that the deceased code search tool? No, it's Programmable. Though it's not actually programmable. I should've written Custom Search Engine instead, that's also a name for it. cse.google.com - It's quaint that past the modern landing page, when using the search portal today, you still get some outdated iteration of Google UI design. It's used, for example, for making OSINT searches.[0] Or at some point by at least one Wikipedia editor for a custom list of Reliable Sources for Anime & Manga.[1] [0] https://www.osintme.com/index.php/2020/09/28/ https://www.osintme.com/index.php/2020/09/28/ [1] https://gwern.net/me#wikis https://gwern.net/me#wikis