3 ms·
"Palantir software is a Java-based platform for analyzing, integrating, and visualizing several types of data, including structured, unstructured, relational, t
by jazzyjackson 6y ago
"Palantir software is a Java-based platform for analyzing, integrating, and visualizing several types of data, including structured, unstructured, relational, temporal, and geospatial. In addition to accessing all natively connected data sources, such as ... Palantir's import process allows Warfighters to easily draw in any other types of data, such as unstructured message traffic, structured identity data, link charts, spreadsheets, phone data, and documents.
Palantir has a link analysis tool similar to Axis-Pro, Analyst Notebook (ANB) and the Distributed Common Ground System-Army (DCGS-A) Standard Cloud (DSC), which are currently used in theater. The Palantir platform uses advanced database technologies, combined with a sophisticated front-end GUI that enables extraction, transformation, and linked of varied datasets. Palantir uses a revisioning database, also known as version control, to documentall modifications performed on objects and entities in the database. Users of Palantir can perform dynamic modeling scenarios in which they manually create links between unrelated objects and entities that update across all datasets in the repository without permanently changing any of the original data"
Essentially a graph database that plays well with geospatial polygon and route searches along with time series', useful for trawling through all your surveillance data and putting together who-did-what to decide who to, erm, target
There's a few screenshots and also pretty interesting user reviews in this Operational Assessment Report published by US Army April 2012
Actually here's my favorite user report on how they use the software, page B-6: "Look for bad guys. Find out who and what those guys are connected to."
https://www.wired.com/images_blogs/dangerroom/2012/08/1830_001.pdf https://www.wired.com/images_blogs/dangerroom/2012/08/1830_0...
- hogFeast 6y agoSo Neo4J (I think that has versioning?) with AirFlow? Seriously, I have never quite understood what all these unstructured data companies do. Autonomy had quite a big product...which, as far as I can tell, was largely about spending heavily on sales and trying to get companies to pay you for warehousing data (with very little of the AI wizardry they claimed to be selling). I think there a publicly listed company that also does this kind of thing...I don't get it. I understand why you can charge an unsophisticated company to hoover up all their useless data, I am not sure how much actual tech is being deployed here beyond that database. EDIT: I think I am recalling Elastic, which I think has an unstructured data business...maybe that is just my imagination.
- taywrobel 6y agoNot Neo4J, so much as a relational database with user-defined schema. They actually build the relational semantics on top of cassandra so that it scales like a beast. And they open sourced it - https://github.com/palantir/atlasdb https://github.com/palantir/atlasdb Now take that, add a few more database technologies to do remote indexing and on the fly imports on federated databases, and some geospatial hotness, give it a swanky UI (now web based, not java), and that’s pretty much the platform, or at least was as of 2014 when I left. And the thing is, they’re remarkably open about all of that... it’s just that people like the boogeyman narrative more, so all the openness about their tech is completely overshadowed, but there’s a reason it and Pinterest were the two hottest internships for college CS students in 2012/2013.
- hogFeast 6y agoOh god, it looks like the schemas are defined in Java. Cold sweat emerging, ORM flashbacks...no, no, I can't, sources of truth everywhere, they are multiplying. Srs, thank you. I will actually take a good look through that as I find this kind of thing interesting. I think there are a few projects that do the converse too: key value on top of relational. I will be honest, I am not sure that I immediately understand the benefit of relational on top of key value...surely that comprises the benefits of going key value? But I don't know, I guess I will need to read more.
- chii 6y agoThese companies have more than just tech - it's a relationships and sales company. They make a product, but that product is heavily customized to a particular client, and each client gets their own customizations. The product isn't mass market enough to be an off the shelf solution. So i would argue that the tech is less important than relationships/connections to build the trust that the product can be delivered as required.