Enthusiastic article for sure. Lots of the hype in this piece suggests that effective semantic search for populating limited context windows of LLMs will be big

Enthusiastic article for sure. Lots of the hype in this piece suggests that effective semantic search for populating limited context windows of LLMs will be big business. My thoughts: 1. Will context windows grow enough so that we can afford to be lazy and drop entire knowledge bases into our queries? 2. Will the actual models of LLMs be able to more reliably capture data in a semi-structured way, perhaps bypassing the "data moat" that the author claims?