4 ms·

Is there anyone out there who has tried linking named entities with an ontology? All I've seen is research but I'm curious if anyone's done any practical work

Is there anyone out there who has tried linking named entities with an ontology? All I've seen is research but I'm curious if anyone's done any practical work in this area. Even if it was a narrowly-scoped ontology it might be pretty interesting.

syllogism 9y ago
That's definitely deployed in production, e.g. to link entities to a summary page in news articles, or in information extraction systems. In practice it's very driven by information retrieval, especially the coverage of the synonym list provided in the ontology. Relevance scores for each ontology entry are also super important. Disambiguation is getting better with neural networks, but it's still really hard. If you have two entities matching for some text, picking the most frequent one gives you a very strong baseline.
yorwba 9y ago
I would be interested in the research you mention in case you have links handy.
- syllogism 9y ago
  The magic words for the task are "Named Entity Disambiguation" and "Named Entity Linking" https://www.semanticscholar.org/search?q=named%20entity%20linking&sort=relevance https://www.semanticscholar.org/search?q=named%20entity%20li... This survey paper I coauthored is outdated now, but it's not the worst place to start: https://www.semanticscholar.org/paper/Evaluating-Entity-Linking-with-Wikipedia-Hachey-Radford/0b8bc4268a2084436f1f1e18bee0b97183ccc3a4 https://www.semanticscholar.org/paper/Evaluating-Entity-Link...
jxub 9y ago
At datamaran [1] we do some of that stuff for assessing non-financial risks with our internal ontology. Also, we are using spaCy and trying out prodigy. Send me an email and I can put you in contact with one of our NLP scientists if you want (they're planning on releasing a paper somewhere soon btw). [1] https://www.datamaran.com https://www.datamaran.com
Radim 9y ago
There's a number of tools that do entity linking (that's the phrase you're looking for), including some open source ones. We've evaluated and used quite a few over the years: there's Dexter [0] by Diego Ceccarelli, Semanticizer by UvA [1] and DBpedia Spotlight [2] and a few others. We've used them for various linking tasks, such as detecting "work skills" in plain text (HR domain) or detecting drug names (medical domain). The amount to which these tools allow "customization" (ease of plugging in your own ontology, support for input format and disambiguation signals) differs. Either way, even though this research includes open source code, the code is more of the "research prototype" kind. Don't expect a plug&play optimized production tool. [0] http://dexter.isti.cnr.it/ http://dexter.isti.cnr.it/ [1] https://github.com/semanticize/semanticizer https://github.com/semanticize/semanticizer [2] https://github.com/dbpedia-spotlight/dbpedia-spotlight https://github.com/dbpedia-spotlight/dbpedia-spotlight
- vadimberman 9y ago
  Would you be interested in a plug&play optimised production tool if it required licensing?

syllogism 9y ago

That's definitely deployed in production, e.g. to link entities to a summary page in news articles, or in information extraction systems. In practice it's very driven by information retrieval, especially the coverage of the synonym list provided in the ontology. Relevance scores for each ontology entry are also super important. Disambiguation is getting better with neural networks, but it's still really hard. If you have two entities matching for some text, picking the most frequent one gives you a very strong baseline.

yorwba 9y ago

I would be interested in the research you mention in case you have links handy.

syllogism 9y ago
The magic words for the task are "Named Entity Disambiguation" and "Named Entity Linking" https://www.semanticscholar.org/search?q=named%20entity%20linking&sort=relevance https://www.semanticscholar.org/search?q=named%20entity%20li... This survey paper I coauthored is outdated now, but it's not the worst place to start: https://www.semanticscholar.org/paper/Evaluating-Entity-Linking-with-Wikipedia-Hachey-Radford/0b8bc4268a2084436f1f1e18bee0b97183ccc3a4 https://www.semanticscholar.org/paper/Evaluating-Entity-Link...

jxub 9y ago

At datamaran [1] we do some of that stuff for assessing non-financial risks with our internal ontology. Also, we are using spaCy and trying out prodigy. Send me an email and I can put you in contact with one of our NLP scientists if you want (they're planning on releasing a paper somewhere soon btw). [1] https://www.datamaran.com https://www.datamaran.com

Radim 9y ago

There's a number of tools that do entity linking (that's the phrase you're looking for), including some open source ones. We've evaluated and used quite a few over the years: there's Dexter [0] by Diego Ceccarelli, Semanticizer by UvA [1] and DBpedia Spotlight [2] and a few others. We've used them for various linking tasks, such as detecting "work skills" in plain text (HR domain) or detecting drug names (medical domain). The amount to which these tools allow "customization" (ease of plugging in your own ontology, support for input format and disambiguation signals) differs. Either way, even though this research includes open source code, the code is more of the "research prototype" kind. Don't expect a plug&play optimized production tool. [0] http://dexter.isti.cnr.it/ http://dexter.isti.cnr.it/ [1] https://github.com/semanticize/semanticizer https://github.com/semanticize/semanticizer [2] https://github.com/dbpedia-spotlight/dbpedia-spotlight https://github.com/dbpedia-spotlight/dbpedia-spotlight

vadimberman 9y ago
Would you be interested in a plug&play optimised production tool if it required licensing?