You seem to be assuming 1. I'm scraping the resized galleries. 2. I don't have the Hath perk that makes the galleries full sized. 3. I don't have a phash-bas

You seem to be assuming 1. I'm scraping the resized galleries. 2. I don't have the Hath perk that makes the galleries full sized. 3. I don't have a phash-based fuzzy image deduplication system on top of all this (see https://github.com/fake-name/IntraArchiveDeduplicator https://github.com/fake-name/IntraArchiveDeduplicator). It's main purpose is to deduplicate manga (https://github.com/fake-name/MangaCMS https://github.com/fake-name/MangaCMS).