The Trump and former president terms were likely firmly stuck together in the embedding space. The model doesn’t validate every single token it produces becaus

The Trump and former president terms were likely firmly stuck together in the embedding space. The model doesn’t validate every single token it produces because validation itself requires tokens. A bloom filter of outdated embeddings will help, when the labs get around to adding it.