5 ms·

Ideas: - Make it generate cryptucurrency, so that the work is not wasted. Either to compensate for server expences hosting the content, or for some noble non-p

Ideas: - Make it generate cryptucurrency, so that the work is not wasted. Either to compensate for server expences hosting the content, or for some noble non-profit cause - all installations would collect the currency to a single account. Wasting the work is worse than these both options. - An easy way for good crawlers (like internet archive) to authenticate themselves. E.g. TLS client side authentication or simply an HTTP request header containing signature for the request (the signature in the header may be based on, for example, on their domain name and the TLS cert for that domain)

ronsor 2y ago
> Make it generate cryptucurrency, so that the work is not wasted. Either to compensate for server expences hosting the content, or for some noble non-profit cause - all installations would collect the currency to a single account. Wasting the work is worse than these both options. The last time[0] we did this, everyone had a meltdown and blocked it. [0] See Coinhive, which conspicuously lacks a Wikipedia page.
- wslh 2y ago
  It is mentioned at <https://en.wikipedia.org/wiki/Cryptojacking https://en.wikipedia.org/wiki/Cryptojacking>
  - avodonosov 2y ago
    And the mention links to https://en.m.wikipedia.org/wiki/Coinhive https://en.m.wikipedia.org/wiki/Coinhive which redirects to https://en.m.wikipedia.org/wiki/Monero#Mining_malware https://en.m.wikipedia.org/wiki/Monero#Mining_malware
- avodonosov 2y ago
  This time the site content will not be available if the challenge computation is blocked.
- xg15 2y ago
  Mining crypto can lead to misaligned incentives. Suddenly, people would have motivation to run this thing even on benign requests, etc.
- Silphendio 2y ago
  There's a German Wikipedia page: https://de.m.wikipedia.org/wiki/Coinhive https://de.m.wikipedia.org/wiki/Coinhive
throwawayEm8UE 2y ago
Maybe there should also be a protocol to support paying a small amount of crypto (on the order of 0.01-0.1 cents per request) to bypass the PoW. The bots can still scrape it by paying, but you now price in the externality.
- avodonosov 2y ago
  Yes, I was also thinking of this. "proof of pay" or "proof of a transaction" An advantage of this would be not wasting electricity for the proof of work computation.
  - deleted 2y ago
    [deleted]
avodonosov 2y ago
Alternatively to cryptocurrency, some other useful c9mputation. Like contribution to BOINC. Only need to find a way to prove the computation.
kebokyo 2y ago
I’m not sure how you can generate cryptocurrency with just sha256 hashes lol. Plus, there’s already a configuration file that lets you determine what you’re looking out for in terms of scrapers. I need to look at it more myself especially because I plan on using this on my own website soon, but I hope there’s already a good way to whitelist archival sites.

ronsor 2y ago

> Make it generate cryptucurrency, so that the work is not wasted. Either to compensate for server expences hosting the content, or for some noble non-profit cause - all installations would collect the currency to a single account. Wasting the work is worse than these both options. The last time[0] we did this, everyone had a meltdown and blocked it. [0] See Coinhive, which conspicuously lacks a Wikipedia page.

wslh 2y ago
It is mentioned at <https://en.wikipedia.org/wiki/Cryptojacking https://en.wikipedia.org/wiki/Cryptojacking>
- avodonosov 2y ago
  And the mention links to https://en.m.wikipedia.org/wiki/Coinhive https://en.m.wikipedia.org/wiki/Coinhive which redirects to https://en.m.wikipedia.org/wiki/Monero#Mining_malware https://en.m.wikipedia.org/wiki/Monero#Mining_malware
avodonosov 2y ago
This time the site content will not be available if the challenge computation is blocked.
xg15 2y ago
Mining crypto can lead to misaligned incentives. Suddenly, people would have motivation to run this thing even on benign requests, etc.
Silphendio 2y ago
There's a German Wikipedia page: https://de.m.wikipedia.org/wiki/Coinhive https://de.m.wikipedia.org/wiki/Coinhive

throwawayEm8UE 2y ago

Maybe there should also be a protocol to support paying a small amount of crypto (on the order of 0.01-0.1 cents per request) to bypass the PoW. The bots can still scrape it by paying, but you now price in the externality.

avodonosov 2y ago
Yes, I was also thinking of this. "proof of pay" or "proof of a transaction" An advantage of this would be not wasting electricity for the proof of work computation.
- deleted 2y ago
  [deleted]

avodonosov 2y ago

Alternatively to cryptocurrency, some other useful c9mputation. Like contribution to BOINC. Only need to find a way to prove the computation.

kebokyo 2y ago

I’m not sure how you can generate cryptocurrency with just sha256 hashes lol. Plus, there’s already a configuration file that lets you determine what you’re looking out for in terms of scrapers. I need to look at it more myself especially because I plan on using this on my own website soon, but I hope there’s already a good way to whitelist archival sites.