he couldnt be more wrong about " it doesn't know what the words _mean_." That's precisely what transformers do do. They know what ever word and semantical str

he couldnt be more wrong about " it doesn't know what the words _mean_." That's precisely what transformers do do. They know what ever word and semantical structure means. They are super fast substitution and relationship machines that can take any word and replace it with its definition, and inherit the link between each word in the definition with all its relationships. It's precisely its ability to distill something into its pure meaning, and to reply to that "meaning" that makes its autocomplete abilities so powerful.