3 ms·
Not only that, the embedding process can represent relationships and ontology, especially the subtle aspects that are hard to capture in edges or json Go back
by verdverm 3y ago
Not only that, the embedding process can represent relationships and ontology, especially the subtle aspects that are hard to capture in edges or json
Go back to the original word2vec example, how would you put this in neo4j, in generalization?
king - man + woman = queen
- dsabanin 3y agoI like your answer and a great example of the limitation of knowledge/semantic graphs. Personally, I'd put a knowledge graph on top of the responses to expose it to LLM as an authority & frame of reference. I think it should be an effective form of protection against hallucination and preventing outright incorrect / harmful outputs in contradiction with the facts known by the graph. At least in my experiments.
- threecheese 3y agoIs it not valuable though to differentiate statistically inferred relationships from those that are user-declared? I would think that a) these are complementary, and b) the potential inaccuracy of the former is much larger than the latter.
- verdverm 3y agoAbsolutely, however this project says > Llamaindex was used to add nodes into the graph store based on documents. So it sounds like they are generating it based on LLM output rather then user-defined. I also wonder how often you need more than a single hop that graphdbs aim to speed up. In an agent system with self-checking and reranking, you're going to be performing multiple queries anyhow There is also interesting research around embedding graphs that overlaps with these ideas.
- esafak 3y agoTopological relationships vs metric relationships. I suppose a great embedding could handle both, but a graph database might help in the tail, where the quality of the embeddings is weaker?
- verdverm 3y agoDoesn't a topological space require a metric? I agree that something that is more like an SQL query, where you have definitive inclusion, will be useful. The harder question is how do you build something like that? How much AI involvement is there in creating the more discrete relation knowledge base.