3 ms·
Author here. Glad I'm not the only one with this problem! What I'm experimenting with is building a graph out of "entities", which I'm calling people, places a
by nsavage 2y ago
Author here. Glad I'm not the only one with this problem!
What I'm experimenting with is building a graph out of "entities", which I'm calling people, places and things found in each card. The point I guess is to allow the LLMs to make connections between cards, but this won't be replacing user made connections.
This lets me pick up all cards that reference something like, I don't know, "factories" as a concept, which isn't something the user will necessarily want to directly connect.
Downside is that deduplicated taxonomy: I have, from a scan through my list, "factories", "Factory" and "Factories". My attempt to head this off is by vector searching based on the proposed entity keywords and having an LLM decide if they are the same or not. I think I need to work on my prompt for this though.
- lukev 2y agoI have a thesis that RDF is good for this sort of work (I gave a talk on it at Clojure Conj last year, https://youtu.be/OxzUjpihIH4 https://youtu.be/OxzUjpihIH4 if you're interested.) It's good for bridging the gaps between LLMs, ontologies, traditional structured data, and logic programming.
- ketedrum 2y agoInteresting, thank you! Gonna watch this asap
- uoaei 2y agoDo you know of any good RDF datasets or repositories to look for? I am familiar with linked data / semantic web but have not kept up on developments for a long while now.
- zozbot234 2y agoYou can refer to the Linked Open Data (LOD) cloud for a network of openly available RDF datasets. Wikidata currently serves as the unofficial "hub" for the cloud, a role that was formerly played by DBpedia.
- spothedog1 2y agoyup I've been working on building a platform entirely built on RDF Ontologies. Excited to try to combine it with LLMs in the not-to-distant future.