Right, but it may be a fixable problem, even under the circumstances. These token generators have vast databases at their disposal and have crawled the entire

Right, but it may be a fixable problem, even under the circumstances. These token generators have vast databases at their disposal and have crawled the entire public-facing internet. They should be able to assign confidence values to their drafts/statements, and reject low-confidence drafts/statements before putting them in front of users. They could do this by fact-checking their drafts in an adversarial way. For instance, a cursory check of isfdb.org would have given ChatGPT better information than I was provided with.