3 ms·

What you can do is: * Share your instance with some friends (though of course it shifts the trust one level down) * Route outgoing requests through tor / some

by 3np 5y ago

What you can do is: * Share your instance with some friends (though of course it shifts the trust one level down) * Route outgoing requests through tor / some VPN. In a hosted environment that you configure once for "everywhere", it's more feasible to do fun things like "Google searches over OperaVPN, bing searches through Mullvad, everything else through Tor". You could even change proxies. Especially with the latter you can kind of "eat the cake and have it too", with some added latency of course. As a bonus, searx can also be configured to rewrite links (yt->piped, twitter->nitter, imgur->rimgu etc) and remove tracking query parameters.

no_time 5y ago
Do you know hosting companies that allow crawling and scanning? Most explicitly forbid such things as it makes their ip addresses worth less.
- 3np 5y ago
  Really? Past employers have done quite heavy automated web queries across several major providers, who never had an issue, even when discussing our use-cases with them. At one point we had ~1000 AWS EIPs in one account solely for increasing throughput (this was an effect of the legacy solution outgrowing its intended lifetime way longer than we wanted, if you scoff at how uneconomical that sounds and is. Just saying, AWS supported us throughout). Either way, what we're talking about here is more akin to an http proxy than scanning/crawling - since every request is explicitly triggered by manual user action as opposed to automated so it shouldn't be any issue. If you expose and advertise a public unauthenticated frontend and end up with 10ks of users maaaaybe some providers will start talking to you about it but otherwise I wouldn't have any concerns. And if you get to that scale, you may already want to look at proxying through providers like Luminati anyway.
- 3np 5y ago
  To add on my other comment: Vultr and Linode are both providing guides on how to set up searx on their platforms, so there you have two that will not raise any issue. https://www.vultr.com/docs/install-searx-with-nginx-on-ubuntu-20-10 https://www.vultr.com/docs/install-searx-with-nginx-on-ubunt... https://www.linode.com/content/maximize-your-privacy-with-searx-diy-cloud/ https://www.linode.com/content/maximize-your-privacy-with-se...

by 3np 5y ago

no_time 5y ago

Do you know hosting companies that allow crawling and scanning? Most explicitly forbid such things as it makes their ip addresses worth less.

3np 5y ago
Really? Past employers have done quite heavy automated web queries across several major providers, who never had an issue, even when discussing our use-cases with them. At one point we had ~1000 AWS EIPs in one account solely for increasing throughput (this was an effect of the legacy solution outgrowing its intended lifetime way longer than we wanted, if you scoff at how uneconomical that sounds and is. Just saying, AWS supported us throughout). Either way, what we're talking about here is more akin to an http proxy than scanning/crawling - since every request is explicitly triggered by manual user action as opposed to automated so it shouldn't be any issue. If you expose and advertise a public unauthenticated frontend and end up with 10ks of users maaaaybe some providers will start talking to you about it but otherwise I wouldn't have any concerns. And if you get to that scale, you may already want to look at proxying through providers like Luminati anyway.
3np 5y ago
To add on my other comment: Vultr and Linode are both providing guides on how to set up searx on their platforms, so there you have two that will not raise any issue. https://www.vultr.com/docs/install-searx-with-nginx-on-ubuntu-20-10 https://www.vultr.com/docs/install-searx-with-nginx-on-ubunt... https://www.linode.com/content/maximize-your-privacy-with-searx-diy-cloud/ https://www.linode.com/content/maximize-your-privacy-with-se...