Because it's not just going to compare URLs; he might well index by that column and compare hashes or something. And doesn't want to store two copies of each U

Because it's not just going to compare URLs; he might well index by that column and compare hashes or something. And doesn't want to store two copies of each URL - decrapified and normal.