What limitation exactly? This one uses a language model to predict likely next words in the sequence so it doesn't have to identify an isolated word from the w

What limitation exactly? This one uses a language model to predict likely next words in the sequence so it doesn't have to identify an isolated word from the whole dictionary. Considering these models can construct valid English passages from absolutely no information, it's not a stretch to imagine something meaningful being generated from even small hints.