this is not what they did. They took unicode and separated it into words. Which seems silly since the online archives are already separated but I guess it's use

this is not what they did. They took unicode and separated it into words. Which seems silly since the online archives are already separated but I guess it's useful for new texts where the word boundaries are not clear