It can understand word boundaries, though. A space is its own token and there are special tokens for common words prefixed with a space or common word prefixes

It can understand word boundaries, though. A space is its own token and there are special tokens for common words prefixed with a space or common word prefixes with a space in front, ex “ a”