4 ms·
It's worth noting that this is a pretty old article. The last 3 years has seen significant development of neural models for text (and graph) processing and alm
by nl 7y ago
It's worth noting that this is a pretty old article.
The last 3 years has seen significant development of neural models for text (and graph) processing and almost all the state-or-the-art results listed there are outdated.
Notably, modern large language models turn out to be very good on their own at large parts of the knowledge extraction problem. OpenAI's GPT is state of the art on the SNLI task[1], and GPT-2[1] is approaching human performance on tasks similar to knowledge extraction.
[1] https://openai.com/blog/language-unsupervised/ https://openai.com/blog/language-unsupervised/
[2] https://openai.com/blog/better-language-models/ https://openai.com/blog/better-language-models/
- riku_iki 7y agoSNLI is also not a knowledge extraction task..
- nl 7y agoIt's listed in this article, and inference is usually necessary for knowledge extraction. (And that previous sentence is a perfect example - you had to infer I was speaking about SNLI, and can extract the knowledge that article is partially about it)