Yes, but the text space is very sparse. Google says: > No results found for "Yes, but the text space is very sparse." You see, not even a random phrase of 8 w

Yes, but the text space is very sparse. Google says: > No results found for "Yes, but the text space is very sparse." You see, not even a random phrase of 8 words is duplicated anywhere. Out of all the possible combinations of words that make sense, only a small portion of them actually exist in the real world. LLMs explore this space that is mostly empty and accomplish useful tasks. They can explore new places by recombining concepts in new ways. They can generate novel ideas by mixing and matching older ideas in ways that make sense.