4 ms·
They apparently say it right here about the ontology approach: https://www.palantir.com/palantir-gotham/technologies/ https://www.palantir.com/palantir-gotham/
by nickpsecurity 10y ago
They apparently say it right here about the ontology approach:
https://www.palantir.com/palantir-gotham/technologies/ https://www.palantir.com/palantir-gotham/technologies/
That's especially hilarious given that approach's failures are what led to investment in machine learning in the first place. Such approaches tend to assume precise information, variables, and rules about the world. Most problems Palantir wants to address... the hard ones... are imprecise with hidden variables/relationships. The machine learning techniques did very well on those kind of mess problems. So, research shifted.
If Palantir is using ontologies for that stuff, then that would certainly be a sign for buyers to run. I still encourage academics to look into such approaches with probabilistic, simple methods in case any advances come up. Fuzzy logic was main one in my day. Just stumbled on a claim today a drone AI did human-level performance using that. Some corroboration for R&D in underdog solutions but not production apps. Haha.
- bazqux2 10y agoHuh, so they are open about it now. They definitely were not when I talked to them. I guess enough time has passed that people have forgotten the hard won lessons of the past. I worked on scaling and generalizing ontologies at university and had already switched to working with Big Data / ML at a big company when Palantir tried to recruit me. I talked to some of their senior engineers about their tech and made the point that their tech sounded just like ontologies. I tried to get them to admit what it was so I could be sure I was having an honest conversation with them. They flatly denied it and made it out like the whole thing was their great new idea. I was unimpressed. I was still interested in working for them. Access to hard interesting problems can be hard to come by. In the end I couldn't take their legendary arrogance and insecurities - to me these are bright red flags of a toxic corporate culture. And they low balled me. I would have temporarily put up with the toxic culture for large piles of money.
- nickpsecurity 10y ago"I was still interested in working for them. Access to hard interesting problems can be hard to come by. In the end I couldn't take their legendary arrogance and insecurities - to me these are bright red flags of a toxic corporate culture. And they low balled me. I would have temporarily put up with the toxic culture for large piles of money." Smart decision. Far as ontologies, the Cyc project to create common sense in machines was my favorite at the time. Used ontological, knowledge base if my broken memory is accurate. I was and still am firmly convinced that finding an architecture suitable to solve that problem is a pre-requisite for the AI's we really want. Deep-learning is approximating it but closer to how brain does vision than common sense. Minsky noted at one point he could count number of researchers doing common sense on a single hand or so. That's a hard problem if you want one. Also unbelievably hard to get funded. (sighs)
- bazqux2 10y agoThanks. There is some interesting work being done with Deep Learning mixed with Bayesian Models and external databases of facts. The training apparently ungodly slow though. My work these days is visual so CNN works well enough. I'm not an authoritative expert in this field though so I'm taking 6 months off to study it intensely, after which I hope to be able to make some meaningful contributions.
- argonaut 10y agoThere is nothing wrong with the ontologies approach. Palantir is not aiming for a fully automated approach. Palantir's core product is a an entity graph mostly used and manipulated by humans for analysis. Basically their software is only meant to augment human analysis. That being said, from my conversations with them, they also have a traditional machine learning team for whenever that approach is needed for a product. But their core product is meant to only help analysis that is mostly done by humans.
- bazqux2 10y agoThere is usually something wrong with the ontologies approach as it rarely works. There is roughly two decades of evidence for this for anyone who cares to look. Five decades if you loosen the definition to include the family of logic and constraint programming - see AI Winter. There is nothing new about these ideas. It always looks and feels like it's going to work which is why humanity has persisted with it for so long and will likely continue to persist for some time to come. There is a whole generation of better techniques that have come out of machine learning that totally eclipses ontologies and I know Palantir isn't using them. Their corporate culture isn't set up for fostering that kind of applied research. No-one is advocating for a fully automated approaches. I don't know where that notion came from. In my view is that Palantir is a consulting company that is pretending to be a tooling company. And their consultants are not worth the money they charge. Just one of many Silicon Valley based frauds.
- dredmorbius 10y agoIs this ontologies within the field of AI not working, or more generally? Do you have references to any specific discussions on this? Curious as I'm doing some work of my own (well outside AI) in which developing ontologies strikes me as useful, though I'd prefer not falling into any well-worn traps. (My use is largely comping up with useful descriptive models of otherwise hairy concepts.)
- bazqux2 10y agoI meant generally they are generally not useful. Sometimes they are. It depends on the purpose and what you want to build and who it's for. Given that you're building a descriptive model it would depend if you're working with facts or with probabilities. If it's facts then Ontologies should work fine, for probabilities I'd recommend Bayesian techniques. The input for these are usually small. From the sounds of it you're generating the input yourself so you should be safe.