The big advantage here would be the ability to attribute entire blocks of text back to a specific source and cross domains just by building a database of embedd

The big advantage here would be the ability to attribute entire blocks of text back to a specific source and cross domains just by building a database of embeddings. The downside is that these networks are probably not as creative as they're limited to only data that's available. It might work best to use something like this as an expert system for a GPT like agent to refer to when needed.