What would happen if each word in "tokenized" to an integer and then you generate tokens instead of characters to produce a string of coherent words instead of

What would happen if each word in "tokenized" to an integer and then you generate tokens instead of characters to produce a string of coherent words instead of random strings? Maybe the answer is obvious but not to me without diving into it at a deeper level. Would be interested to hear anyones thoughts on this.