5 ms·
A lot of people in this thread are raising questions about what Palantir actually does. I worked as a software developer at Palantir in 2014, so maybe I can she
by manfredo 6y ago
A lot of people in this thread are raising questions about what Palantir actually does. I worked as a software developer at Palantir in 2014, so maybe I can shed some light on this though this info may not be up to date. Back then they had two main products: Palantir Gotham and Palantir Metropolis. Accompanying this was a big infrastructure to ingest data from various sources. First the two frontends:
Gotham is focused on displaying entity based data. Entity based data was often things like people, reports of events, invoices, etc. Gotham let you do things like click on a person, and see all criminal records associated with them. Or their relatives and known associates. This was called "search around" and was apparently a very big deal. One sample use case for Palantir Gotham was to search for people that made more than one purchase of the same Schedule 2 drug, and plot those purchases on a map. A common method of finding pill mills was to plot these drug purchases on a map and see when there's a bunch of purchases along a highway route. Big indicator that someone is buying in bulk, but splitting up their purchases to fall under thresholds which traditional alerting mechanisms relied upon. Palantir Gotham is the product that people usually associate with Palantir - it's the one used by a lot of three letter agencies.
I don't know too much about Metropolis. It was more about quantitative analysis. I think it was popular for insurance companies. IIRC it could do things like plot the frequency of adverse weather events on a map, and then insurance adjusters to fine tune premiums. I think there was also a Palantir Metropolis product aimed at small businesses.
Now, the above covers the frontend. A huge part of Palantir's operations is data ingestion. Basically, this consisted of moving data out of government or enterprise databases and moving them into Palantir's format. This usually involved forward deployed engineers that would work with the government or business and work out a way to ingest the data. An un-glamorous job but one of the really important ones.
Another huge component of the business was customer specific customization. When I worked there something like 40-50% of software engineers worked on business development. They rest worked either on infrastructure of UI platform (basically building the components of the UI that aren't customer specific). Business development at Palantir when I worked meant "software development for a given business (or agency)" not sales. If you worked in business development you were a developer for a given business or agency. This was also a lot of grunt work. One customer wanted to bucket items based on the phase of the moon. I distinctly remember this ask - maybe the FBI was investigating a werewolf. Implementing features and customizations like that was the role of business development.
Is it a powerful tool or is it snakeoil? Well, given that the workflows it's replacing are often whiteboards and excel spreadsheets it may actually be a very significant gain. Ultimately what Palantir has is a flexible way of displaying and finding relationships between data. Flexible enough to ingest very different types of data. Perhaps more importantly they have a technical workforce capable of rapidly extending the product to meet new customer needs. And if customers are happy with the product I guess it's worth it.
I just hope they've moved off of god-damn java swing for the UI.
- manfredo 6y agoHere's a few demos to actually see the product in action. * This is Palantir Gotham: https://www.youtube.com/watch?v=jZug8kV28RU https://www.youtube.com/watch?v=jZug8kV28RU * This is a more generic talk. Skip to the 22:00 mark: https://www.youtube.com/watch?v=XyDEHCcQ_bk https://www.youtube.com/watch?v=XyDEHCcQ_bk * Also gotham: https://www.youtube.com/watch?v=_Q8bwhAW2Mg https://www.youtube.com/watch?v=_Q8bwhAW2Mg * Using gotham to detect money laundering: https://www.youtube.com/watch?v=XCR_LBzur-k https://www.youtube.com/watch?v=XCR_LBzur-k I want to find a demo of metropolis but alas I can't seem to find one.
- stanfordkid 6y agoSo basically it's an Orwellian surveillance tool that justifies it's own existence based upon remnants of an unjust war on drugs created by Nixon? I'm so sick and tired of Palantir's advertising tactics of doing good. We should enable the government to create massive databases of peoples lives and communication, then link those ... so that we can stop kids from doing ecstacy or "catch terrorists". Give me a break. Palantir is basically like PRISM ... except it came out of the minds of Silicon Valley (from whom I would expect much more) ... than the NSA/CIA
- manfredo 6y agoThe main use case or illicit drug detection that I as aware of was detecting fraudulent pharmacies selling shitloads of legal opiods. Which primarily affects rural white people - I don't think that's part of Nixon's drug war which primarily targeted inner city people. And the drug detection use case is only one example. IIRC anti-terror work was the first big use case for Palantir Gotham. As far as whether or not it's an Orwellian tool, one thing to be aware of is that Palantir doesn't collect any data or have access to government data. The ingested data is still administered by the agency. I don't think they can even legally transfer it to 3rd parties. Palantir builds tools to browse and make correlations with the data that government agencies already have. It's more of an investigation tool, not a surveillance tool. There's a substantial latency between something happening and being able to actually see it in Palantir - it needs to first be logged and recorded, and then go through the ingestion pipeline. Sure, it's a valid position to be against government collection of things like pharmacy purchases and financial transactions. But that strikes me more of a moral position against government data collection rather than something specific to Palantir.