5 ms·

Here's what I said when the story first came out: "I'm not so sure their technology is as futuristic as everyone thinks it is. If I had to take an educated gue

Here's what I said when the story first came out: "I'm not so sure their technology is as futuristic as everyone thinks it is. If I had to take an educated guess, I would say it's some powerful AI that makes their knowledge graph smarter. Currently Google's Knowledge Graph uses more structured data sets and depends on a mechanism like this: http://www.zachvanness.com/nanobird_relevancy_engine.pdf http://www.zachvanness.com/nanobird_relevancy_engine.pdf But the real challenge is to make the knowledge graph update in real time and take meaning from something as unstructured as a blog post or an email. And to do something like that requires some really unique AI." This is most likely what they are going to be implementing: http://www.zachvanness.com/nanobird_relevancy_engine_vision.pdf http://www.zachvanness.com/nanobird_relevancy_engine_vision....

hnriot 13y ago
why repeat an empty comment? It's clear that you don't really have any knowledge of, or insight into state of the art machine learning, so I don't see the need to paste in what you've already said. It's very hard for those not familiar with the field to see when something is novel, much of ML looks "obvious" to a typical developer. As for Google's KG, updating the model in real time isn't really necessary, knowledge doesn't typically advance emails or blog posts at a time. They already have that in their search, knowledge is something that is mutually agreed upon and takes some amount of consensus. Using the structured sources (like freebase) is much better than trying to do dependency parsing on some blog post and try to make sense of it. Powerset tried that and it didn't work then, and won't work for at least a few years. ML advances not in leaps and bounds but rather by little pieces of the puzzle falling into place. The biggest thing to happen to the ML world isn't algorithms or fast computers, but the abundance of data available. Like pagerank, the more data it has, the better it works, the same is true of ML systems. Google has more data than god, and it is through this they will push the frontiers of AI - along with IBM and the others working in this field.
- nl 13y ago
  Using the structured sources (like freebase) is much better than trying to do dependency parsing on some blog post and try to make sense of it. Powerset tried that and it didn't work then, and won't work for at least a few years. Evidence extraction from unstructured data is a pretty active area of research. Clearly structured data is "better", but the issue with many structured sources is they don't accurately represent knowledge. For example, answering "What is the capital of Israel" and/or "what is the capital of Palestine" really depends on both who is asking and who is answering. Unstructured data is generally good at showing controversy like that.
  - eli_gottlieb 13y ago
    >For example, answering "What is the capital of Israel" and/or "what is the capital of Palestine" really depends on both who is asking and who is answering. Wow, did you just ever open a can of worms. Legally speaking, the capital of Israel is Jerusalem, and the capital of Palestine is currently Ramallah. These are also the practical capitals, in the sense of these cities containing their respective national governments and institutions. Things only get thorny when you start trying to ask about what capitals are recognized by other countries. Then you start getting nonsense answers, like the capital of Israel being in Tel-Aviv (then why isn't the Knesset there?) and the capital of Palestine being nonexistent due to occupation (then where does the Palestinian Authority govern from?). For legal and practical purposes, there are answers to these questions. People are just embarrassed to contradict their own politics by speaking these answers aloud. So if we're talking about knowledge extraction, if I were Google, I would give the legal and practical answers. Telling someone the capital of Israel is in Tel-Aviv may be politically correct in some places, but it won't get them to the state office they need to visit. Anyway, consider me to be wearing my flame-proof suit.
    - nl 13y ago
      This is exactly my point (to be pedantic Palestine actually claims Jerusalem as its capital too).
      - eli_gottlieb 13y ago
        Palestine can claim all it likes: their government offices are not physically located in Jerusalem, and the location of those offices is what a Search user needs to know.
        nl 13y ago
        Interestingly, Google says the capital of Palestine is Jerusalem. I'm not at all sure the location of government offices is a good metric to base that answer on. The Netherlands and South Africa are good counter-examples (each separate the legislative and official capitals), and I suspect there are plenty more[1] (I didn't downvote you, BTW) [1] http://en.wikipedia.org/wiki/List_of_countries_with_multiple_capitals http://en.wikipedia.org/wiki/List_of_countries_with_multiple...
dclara 13y ago
I think your information is valuable and relevant. You have a point on the KG mechanism using structured data and unstructured data. I agree with you not necessarily on the real time update. Maybe using unstructured data is too hard to manage, especially with "unsupervised learning algorithm". My master's degree thesis was using this kind of neural network training mechanism to do image recognition. But to understand human context? I'm not a big believer about AI. The thing I noticed is that DeepMind is good at advance game AI, smarter recommendation system for online commerce and image search, not context or knowledge with distributed system. Is it going to deviate DeepMind's direction? This is my concern.

hnriot 13y ago

why repeat an empty comment? It's clear that you don't really have any knowledge of, or insight into state of the art machine learning, so I don't see the need to paste in what you've already said. It's very hard for those not familiar with the field to see when something is novel, much of ML looks "obvious" to a typical developer. As for Google's KG, updating the model in real time isn't really necessary, knowledge doesn't typically advance emails or blog posts at a time. They already have that in their search, knowledge is something that is mutually agreed upon and takes some amount of consensus. Using the structured sources (like freebase) is much better than trying to do dependency parsing on some blog post and try to make sense of it. Powerset tried that and it didn't work then, and won't work for at least a few years. ML advances not in leaps and bounds but rather by little pieces of the puzzle falling into place. The biggest thing to happen to the ML world isn't algorithms or fast computers, but the abundance of data available. Like pagerank, the more data it has, the better it works, the same is true of ML systems. Google has more data than god, and it is through this they will push the frontiers of AI - along with IBM and the others working in this field.

nl 13y ago
Using the structured sources (like freebase) is much better than trying to do dependency parsing on some blog post and try to make sense of it. Powerset tried that and it didn't work then, and won't work for at least a few years. Evidence extraction from unstructured data is a pretty active area of research. Clearly structured data is "better", but the issue with many structured sources is they don't accurately represent knowledge. For example, answering "What is the capital of Israel" and/or "what is the capital of Palestine" really depends on both who is asking and who is answering. Unstructured data is generally good at showing controversy like that.
- eli_gottlieb 13y ago
  >For example, answering "What is the capital of Israel" and/or "what is the capital of Palestine" really depends on both who is asking and who is answering. Wow, did you just ever open a can of worms. Legally speaking, the capital of Israel is Jerusalem, and the capital of Palestine is currently Ramallah. These are also the practical capitals, in the sense of these cities containing their respective national governments and institutions. Things only get thorny when you start trying to ask about what capitals are recognized by other countries. Then you start getting nonsense answers, like the capital of Israel being in Tel-Aviv (then why isn't the Knesset there?) and the capital of Palestine being nonexistent due to occupation (then where does the Palestinian Authority govern from?). For legal and practical purposes, there are answers to these questions. People are just embarrassed to contradict their own politics by speaking these answers aloud. So if we're talking about knowledge extraction, if I were Google, I would give the legal and practical answers. Telling someone the capital of Israel is in Tel-Aviv may be politically correct in some places, but it won't get them to the state office they need to visit. Anyway, consider me to be wearing my flame-proof suit.
  - nl 13y ago
    This is exactly my point (to be pedantic Palestine actually claims Jerusalem as its capital too).
    - eli_gottlieb 13y ago
      Palestine can claim all it likes: their government offices are not physically located in Jerusalem, and the location of those offices is what a Search user needs to know.
      - nl 13y ago
        Interestingly, Google says the capital of Palestine is Jerusalem. I'm not at all sure the location of government offices is a good metric to base that answer on. The Netherlands and South Africa are good counter-examples (each separate the legislative and official capitals), and I suspect there are plenty more[1] (I didn't downvote you, BTW) [1] http://en.wikipedia.org/wiki/List_of_countries_with_multiple_capitals http://en.wikipedia.org/wiki/List_of_countries_with_multiple...

dclara 13y ago

I think your information is valuable and relevant. You have a point on the KG mechanism using structured data and unstructured data. I agree with you not necessarily on the real time update. Maybe using unstructured data is too hard to manage, especially with "unsupervised learning algorithm". My master's degree thesis was using this kind of neural network training mechanism to do image recognition. But to understand human context? I'm not a big believer about AI. The thing I noticed is that DeepMind is good at advance game AI, smarter recommendation system for online commerce and image search, not context or knowledge with distributed system. Is it going to deviate DeepMind's direction? This is my concern.