6 ms·

A CSV file with 80k tweets from the day of the capitol hill riots

28 points by IvanSologub 6y ago

easytiger 6y ago
Presumably against twitter's T&C?
- ianbooker 6y ago
  Presumably. It would suffice to just report the tweet ids, then you can "rehydrate" these into full tweets using the API.
  - woliveirajr 6y ago
    > Each row comes with only a fraction of a tweet's data. You can use the tweet IDs with this tool to get everything: So, not the whole thing.
posedge 6y ago
Are the tweets filtered for the event in any way, or is it just a random collection from all of twitter on that day?
- CodesInChaos 6y ago
  Looks like it's based on search queries: pandemic 5847 lockdown 5847 testing 5847 vaccine 5847 covid 5843 stock market 5843 jobs 5843 president 5842 mask 5840 travel 5839 spread 5837 economy 5836 quarantine 5836 unemployment 3045 coronavirus 2822 death rates 495
temptemptemp111 6y ago
CNN was there dressed as patriots hahaha
williesleg 6y ago
I'd love to see the Portland antifa tweets, those were really fun!
GreenHeuristics 6y ago
Did you do the same for this? https://wtop.com/dc/2020/05/dc-protests-of-george-floyds-death-expected-for-a-3rd-night/ https://wtop.com/dc/2020/05/dc-protests-of-george-floyds-dea...
- hd4 6y ago
  That would have been racist
- bbno4 6y ago
  What's stopping you from doing that? This is open source work, they are not being paid to do this so you should not expect everyone to do work for you, for free :)
- krageon 6y ago
  I'm trying to read your comment charitably but I just can't find a humanising reason to post this. Because it's kind of unfair to assume you have a poor reason to do so, perhaps it would help me and hopefully other readers if you explained your line of thought here. Why do you want to know this?
- fabbari 6y ago
  I am not going to pretend you are engaging in civilized discussion. You are comparing people protesting against a constant threat to their lives from law enforcement - ask any black parent about "the talk" - to people protesting losing an election fomented by lies. On one side you have a real issue impacting the life of millions of people daily, on the other you have an issue artificially created based on lies, falsehoods and misdirection. These are not even remotely similar events, not by any measure. The response to these events from law enforcement was not close, nor comparable. Stop this false equivalence.
  - brynjar 6y ago
    Can I humbly make an observation? I agree the two events are not equivalent. Nevertheless, I think the bar has to be set higher before deciding a person is not worth talking to. "I am not going to pretend you are engaging in civilized discussion." Are you sure you know this? I don't know who GreenHeuristics is, perhaps his comment is in good faith, perhaps not, I don't know. But his comment wasn't a mad rant, how ever much anyone may dislike it.
dsnr 6y ago
When state surveillance is not enough and “involved” citizens start to roll out their own. Don’t forget to “cancel” everyone on that list and keep the society divided for as long as possible.
- wukerplank 6y ago
  > keep the society divided for as long as possible There can't be unity with fascists. They don't respect the values and rules of a democracy.
  - jfengel 6y ago
    It would have been interesting to be in the room where they decided that "unity" was going to be the word of the day. After four years (and much longer) of very explicit divisiveness, where the whole notion of "unity" would have been met with derision, the rapid turnaround is giving me whiplash. I know it's probably not just one room where it happened, and in a lot of ways it's a pretty obvious strategy. Still, I just have to wonder if there was even a moment of self-reflection. "Do you think they'll be skeptical if our talking points are about unity in the immediate wake of accusing people of trying to steal an election, which we believed to the point of provoking violence? Nah."
- celim307 6y ago
  Curious choice to focus blame on the people investigating and not the people making literal death threats...
  - deleted 6y ago
    [deleted]
- luma 6y ago
  Freedom of speech != freedom from consequences of your speech. It's not like somebody hacked someone's private messaging system. If you put the world on blast with your dumb ideas, I don't have any problem with others pointing it out.
jcims 6y ago
The only commonality I see beyond the timeframe is that nearly all of the tweets have the word 'death' in them. :/
secondcoming 6y ago
Only a fool would use twitter. It's a place where anything you say can and will be held against you in the court of public opinion FOREVER. If you must use it, then read-only mode should be sufficient. Leave the contributions to marketers and narcissists chasing likes.
twosdai 6y ago
https://github.com/twintproject/twint https://github.com/twintproject/twint This is a much more advanced OSINT tool which can provide you better information if you really want to search for tweets within a specific area, or around a specific timeframe. Here is an example command which would give you any tweet containing the word trump within a 50Km radius of DC. twint -g="38.8935755,-77.0846155,50km" -s "Trump"

28 points by IvanSologub 6y ago

easytiger 6y ago

Presumably against twitter's T&C?

ianbooker 6y ago
Presumably. It would suffice to just report the tweet ids, then you can "rehydrate" these into full tweets using the API.
- woliveirajr 6y ago
  > Each row comes with only a fraction of a tweet's data. You can use the tweet IDs with this tool to get everything: So, not the whole thing.

posedge 6y ago

Are the tweets filtered for the event in any way, or is it just a random collection from all of twitter on that day?

CodesInChaos 6y ago
Looks like it's based on search queries: pandemic 5847 lockdown 5847 testing 5847 vaccine 5847 covid 5843 stock market 5843 jobs 5843 president 5842 mask 5840 travel 5839 spread 5837 economy 5836 quarantine 5836 unemployment 3045 coronavirus 2822 death rates 495

temptemptemp111 6y ago

CNN was there dressed as patriots hahaha

williesleg 6y ago

I'd love to see the Portland antifa tweets, those were really fun!

GreenHeuristics 6y ago

Did you do the same for this? https://wtop.com/dc/2020/05/dc-protests-of-george-floyds-death-expected-for-a-3rd-night/ https://wtop.com/dc/2020/05/dc-protests-of-george-floyds-dea...

hd4 6y ago
That would have been racist
bbno4 6y ago
What's stopping you from doing that? This is open source work, they are not being paid to do this so you should not expect everyone to do work for you, for free :)
krageon 6y ago
I'm trying to read your comment charitably but I just can't find a humanising reason to post this. Because it's kind of unfair to assume you have a poor reason to do so, perhaps it would help me and hopefully other readers if you explained your line of thought here. Why do you want to know this?
fabbari 6y ago
I am not going to pretend you are engaging in civilized discussion. You are comparing people protesting against a constant threat to their lives from law enforcement - ask any black parent about "the talk" - to people protesting losing an election fomented by lies. On one side you have a real issue impacting the life of millions of people daily, on the other you have an issue artificially created based on lies, falsehoods and misdirection. These are not even remotely similar events, not by any measure. The response to these events from law enforcement was not close, nor comparable. Stop this false equivalence.
- brynjar 6y ago
  Can I humbly make an observation? I agree the two events are not equivalent. Nevertheless, I think the bar has to be set higher before deciding a person is not worth talking to. "I am not going to pretend you are engaging in civilized discussion." Are you sure you know this? I don't know who GreenHeuristics is, perhaps his comment is in good faith, perhaps not, I don't know. But his comment wasn't a mad rant, how ever much anyone may dislike it.

dsnr 6y ago

When state surveillance is not enough and “involved” citizens start to roll out their own. Don’t forget to “cancel” everyone on that list and keep the society divided for as long as possible.

wukerplank 6y ago
> keep the society divided for as long as possible There can't be unity with fascists. They don't respect the values and rules of a democracy.
- jfengel 6y ago
  It would have been interesting to be in the room where they decided that "unity" was going to be the word of the day. After four years (and much longer) of very explicit divisiveness, where the whole notion of "unity" would have been met with derision, the rapid turnaround is giving me whiplash. I know it's probably not just one room where it happened, and in a lot of ways it's a pretty obvious strategy. Still, I just have to wonder if there was even a moment of self-reflection. "Do you think they'll be skeptical if our talking points are about unity in the immediate wake of accusing people of trying to steal an election, which we believed to the point of provoking violence? Nah."
celim307 6y ago
Curious choice to focus blame on the people investigating and not the people making literal death threats...
- deleted 6y ago
  [deleted]
luma 6y ago
Freedom of speech != freedom from consequences of your speech. It's not like somebody hacked someone's private messaging system. If you put the world on blast with your dumb ideas, I don't have any problem with others pointing it out.

jcims 6y ago

The only commonality I see beyond the timeframe is that nearly all of the tweets have the word 'death' in them. :/

secondcoming 6y ago

Only a fool would use twitter. It's a place where anything you say can and will be held against you in the court of public opinion FOREVER. If you must use it, then read-only mode should be sufficient. Leave the contributions to marketers and narcissists chasing likes.

twosdai 6y ago

https://github.com/twintproject/twint https://github.com/twintproject/twint This is a much more advanced OSINT tool which can provide you better information if you really want to search for tweets within a specific area, or around a specific timeframe. Here is an example command which would give you any tweet containing the word trump within a 50Km radius of DC. twint -g="38.8935755,-77.0846155,50km" -s "Trump"