15 ms·
Also embarrassing: https://www.vice.com/en/article/n7vqew/the-hacker-who-archived-parler-explains-how-she-did-it-and-what-comes-next https://www.vice.com/en/ar
by jrochkind1 6y ago
Also embarrassing:
https://www.vice.com/en/article/n7vqew/the-hacker-who-archived-parler-explains-how-she-did-it-and-what-comes-next https://www.vice.com/en/article/n7vqew/the-hacker-who-archiv...
> donk_enby had originally intended to grab data only from the day of the Capitol takeover, but found that the poor construction and security of Parler allowed her to capture, essentially, the entire website. That ended up being 56.7 terabytes of data, which included every public post on Parler, 412 million files in all—including 150 million photos and more than 1 million videos. Each of these had embedded metadata like date, time and GPS coordinates—unlike most social media sites, Parler does not strip metadata from media its users upload, which, crucially, could be useful for law enforcement and open source investigators.
- f430 6y ago> GPS coordinates—unlike most social media sites, Parler does not strip metadata from media its users upload, which, crucially, could be useful for law enforcement OH SHI- This is a colossal mess up, on epic proportions.
- dvdbloc 6y agoA mess up if you intended to protect your users...
- slg 6y agoDue to the people involved, Parler is almost certainly not a honeypot setup by the FBI, CIA, or some other government organization. However some of the details that have leaked out over the last week made me wonder how little of the site would have changed if that was the intended purpose.
- throwanem 6y agoIt would probably have been more secure.
- KMag 6y agoSufficiently advanced incompetence is indistinguishable from malice.
- tlrobinson 6y agoHah, this is great. If you don't get the references, it's Hanlon's Razor ("Never attribute to malice that which is adequately explained by stupidity") plus Arthur C. Clarke's "3rd law" ("Any sufficiently advanced technology is indistinguishable from magic.") Apparently it's called Grey's Law: https://www.urbandictionary.com/define.php?term=Grey%27s%20Law https://www.urbandictionary.com/define.php?term=Grey%27s%20L...
- nullsense 6y agoDoes that make it a "quotemanteau"? Wait... Is that a thing? Are there more of these?
- riffraff 6y agoI vote for "quotemanteau" to be officially sanctioned! But I would say the specific case is merely a snowclone[0] of "any sufficiently X is indistinguishable from Y" [0] https://en.wikipedia.org/wiki/Snowclone https://en.wikipedia.org/wiki/Snowclone
- nullsense 6y agoIt appears to have the properties of both in this case. That is to say it's a snowclone where the substitutions come from another quote. I guess quotemanteaus are a special kind of unique snowclone. You could take "with great power comes great responsibility" and form the snowclone "with great X comes great Y" and then take the quote "the medium is the message" and use those in your snowclone to make the quotemanteau "with a great medium comes a great message" Hmm... I feel like I should try concoct more of these. They're fun.
- frays 6y agoThank you for the explanation.
- xkcd-sucks 6y agoIt's pretty well demonstrated that Three Letter Agencies really like enticing idiots people into fantasy situations well above their competency in order to generate terrorism convictions so it's always a possibility even if there's no demonstrable third party malicious action
- pc86 6y agoAnd in this case there is demonstrable malicious action.
- astronautjones 6y agothis is true "female body inspector" shirt clientele though
- pelliphant 6y agothey would have required authentication for their api calls if that was the case... Besides that, probably not much. =)
- Exmoor 6y agoIndeed. The level of security failure was pretty incredible. They named media serially (So, pics/1.jpg, pics/2.jpg, etc.) and did not have any validation that you were allowed to access what you were grabbing so it was literally as easy as possible to grab everything. Oh, and did I mention that private messages were also fully accessible?
- f430 6y agoI am convinced this was an inside job. There is simply no way someone can be this incompetent without willful intent.
- redisman 6y agoLet me introduce you to every early stage startup in the world. Plenty of mature companies also have completely abysmal security practices
- missedthecue 6y agoEver worked for a startup? This is what "move fast, break things" does.
- vlovich123 6y agoI have but only at competent ones. Nothing this flagrantly bad.
- redisman 6y agoI’ve seen not quite this bad but definitely in the same order of magnitude
- nafey 6y agoThis happens at established firms as often as startups.
- bawolff 6y agoYou'd be surprised how incompetent people can be when it comes to security. Nothing i have heard so far would really surprise me for a small startup with very rapid growth.
- neuronexmachina 6y agoSomeone put together an animated heatmap of Parler photo locations along the Mall throughout the day of 1/6: https://www.reddit.com/r/dataisbeautiful/comments/kvx88n/oc_animated_heatmap_of_parler_video_gps_metadata/ https://www.reddit.com/r/dataisbeautiful/comments/kvx88n/oc_...
- deleted 6y ago[deleted]
- stouset 6y agoWhat I find astonishing is that—at least according to that heat map—it appears that bordering on 100% of the people using Parler in DC that day we’re part of the riot / coup / insurrection. This isn’t an app that’s in widespread general use but just so happens to also have a few bad apples using it too. It’s instead almost exclusively used by what would appear to be the most radical wing of the Trump party. Almost every single person using it during that period attended Trump’s speech and/or participated (in some way, shape, or form) in an assault on the Capitol that day.
- cozzyd 6y agoI mean, look how DC voted in the last election.
- eyelidlessness 6y agoThe same way it has since I’ve been alive. What’s your point?
- cozzyd 6y agothat a DC citizen is exceedingly unlikely to be a Parler user unless they're an external protestor or a congressperson (or congressional staff, I guess).
- gabereiser 6y agoThis was exactly my take away from the heat map. If that's all the GPS coords from video taken on Parler that day than it looks to be exclusively used by those supporting/participating/sharing the riot on the US Capital.
- MivLives 6y agoI'm curious where someone just gets 56.7 tb of storage that quickly.
- ckdarby 6y agoAWS. If not them because in you're worried they'd also shut you down than probably BackBlaze. Could also just buy a bunch of fairly cheap 100 mbit unmetered boxes off OVH/Kimsufi for a total cost probably of ~$300/m.
- ikiris 6y agoYou can get that in 5 drives from best buy these days. Not exactly a huge leap for cloud storage.
- j2bax 6y agoI believe the person that pulled it down is a digital archivist. I’m sure she has plenty of storage laying around for such occasions.
- adwww 6y agoPresumably just another s3 bucket? Do all your transferring from an EC2 instance in the same region and it never needs to waste bandwidth going over the public internet anyway.
- jackweirdy 6y agoOr local storage. The DataHoarder subreddit where a lot of similar efforts are coordinated has a lot of info about building dense home storage on the cheap
- polar 6y ago> laying around ITYM lying around, unless this is a quirk of US English. Sorry to be pedantic!
- nkrisc 6y ago
- 2Gkashmiri 6y agoWhat exactly is the feed Amazon was getting from Parker from that much stuff? Like it needed just as much bandwidth if not more and dedicated boxes for software to run on. It wasnt cheap, or was it?
- jon-wood 6y agoI don't have a good source on this, but I saw $300,000/month bandied about social media the other week.
- deleted 6y ago[deleted]
- apple_innocent 6y agoA different take on Parler's connection (or not) to the events of 6 Jan 2021: https://web.archive.org/web/20210112145206/https://greenwald.substack.com/p/how-silicon-valley-in-a-show-of-monopolistic https://web.archive.org/web/20210112145206/https://greenwald...
- pstuart 6y agoThat's just, like, his opinion man. Let's see what comes out of this data dump before getting too sanguine about loss of "free speech".
- Shared404 6y ago> "free speech". On this topic, I've seen reports on Twitter and Reddit of people who don't fit Parler's "prescribed worldview" being banned. Not so free after all.
- joshxyz 6y agoJesus fucking christ i thought it's just some users table but 56.7 terabytes you mofos that's some s3 egress bill!
- aljarry 6y ago90$ per TB
- minot 6y agoIs there still no easy straightforward way in $current_year to put an absolute spend cap of say USD 0, USD 5, or USD 10 per month on Amazon.com web services or Google Cloud Platform? I’d think I’d like to prepay a fixed dollar amount like USD 200 IF I anticipate some major event but really this is problematic for students. I just want to use the free tier. Why is this so hard?
- raxxorrax 6y agoI don't think so. It would be great though to encourage dabbling. I am glad that my customers and company pays the bills because they can fluctuate very noticeably. For private use I still host my own server just because the costs are fixed an I know what I am getting.
- Red_Leaves_Flyy 6y agoYou're not a customer they want.
- ardy42 6y ago> The Hacker Who Archived Parler Explains How She Did It (and What Comes Next) I'm really glad she did that. I'm fine with all this stuff getting taken down, but it really needs to be archived somewhere for historical purposes, to help understand this moment. Given the kind of media and political impact Trump's tweets from @theRealDonaldTrump have been, I really hope they're archived at NARA along with the @POTUS tweets. They're legit historical primary source documents.
- rendall 6y ago> "I'm fine with all this stuff getting taken down" I understand this on a visceral level, but I wish more people would look beyond that to the implications for communication on the web. This action by Amazon happens to correspond with what I think is right and just on first iteration, but what principle prevents Amazon from arsing some other group that we agree with?
- kennywinker 6y agoThe only principal that protects that kind of group is that we agree with it. It’s not much, but it’s something.
- rendall 6y agoIf only there were some principle or value that would somehow... allow us to express opinions even if others - even powerful people, or even the majority of people - disagreed with us. Some kind of inalienable right. Hmm. It is a mystery.
- kennywinker 6y agoYou can express opinions all you want, but you’re going to have to do a lot of work in order to justify compelling someone to do business with you after you say something they don’t like. Like, amazon isn’t actually the basic infrastructure of the internet. You can build web sites and apps without involving them. So why would a law force them to do business with you?
- a012 6y agoThis is the proof to why I strip all metadata AND filename (esp. photos from camera include timestamp in filename) before uploading it to share one social medias.
- blntechie 6y agoiOS now have an option to do this natively. But I find it bit convoluted. My go to app for stripping out metadata from photos is Exif Viewer.
- Fnoord 6y agoMy camera apps never include GPS coordinates to begin with (which is enough stripping for me, but then again I'm not part of Qanon and all that).
- enriquto 6y agoCamera vendors are perfectly capable of storing a lot of metadata in the jpeg encoded image itself, in an steganographic way. If you want to really be sure, crop your image to a position that is not multiple of 8 on any direction, then scale it by a factor very close to 1, add some noise, and re-compress it again. Some steganography is yet robust to that, but only the really fancy stuff. Anyhow, if your image shows recognizable landmarks with shadows, then it will be feasible to recover the exact point of view and the time of acquisition.
- Ntrails 6y ago> Anyhow, if your image shows recognizable landmarks with shadows, then it will be feasible to recover the exact point of view and the time of acquisition. With what level of accuracy? Are you claiming you can confidently assert 2020-12-21 15:12 over, say, 2020-12-22 15:15 via shadows
- enriquto 6y ago> confidently assert 2020-12-21 15:12 over, say, 2020-12-22 15:15 via shadows Not at all. By visual inspection you can see whether it's the morning or the afternoon (if you know the orientation of the landmarks). I guess by image processing you could get a precision of +- 1h maybe?
- philshem 6y agoThey were downloading at 50 Gbps for a while https://twitter.com/donk_enby/status/1348497204940595201 https://twitter.com/donk_enby/status/1348497204940595201 https://twitter.com/donk_enby/status/1348440720504401921 https://twitter.com/donk_enby/status/1348440720504401921 Also, auth provider (twilio?) removed Parler as a client so for a short while it was possible to create accounts without a phone number (2FA). https://twitter.com/donk_enby/status/1348298836930867204 https://twitter.com/donk_enby/status/1348298836930867204 edit: okta, free trial, thanks: https://news.ycombinator.com/item?id=25774943 https://news.ycombinator.com/item?id=25774943
- alborzb 6y agoJust a note here, it wasn't Twilio. It was a free trial of Okta that they were using for their entire userbase. https://twitter.com/okta/status/1348191370528256002?ref_src=twsrc%5Etfw https://twitter.com/okta/status/1348191370528256002?ref_src=...
- secondcoming 6y agoShe is probably liable for that data egress bill. Also, how does some randomer have ten of terabytes of disk lying around?
- Nextgrid 6y agoMaybe the data compresses well and/or a lot of it is redundant (so instead of storing it raw you store it in a database and use relationships to link related pieces of data)?