3 ms·

>If the average length of a tweet (minus headers) is ~100 bytes of text, that’s only 50GB. You could fit it on a USB stick. https://twitter.com/elonmusk/status

by webo 4y ago

>If the average length of a tweet (minus headers) is ~100 bytes of text, that’s only 50GB. You could fit it on a USB stick. https://twitter.com/elonmusk/status/1534939289653592065 https://twitter.com/elonmusk/status/1534939289653592065

deleted 4y ago
[deleted]
ceejayoz 4y ago
You can't do bot detection with just the tweet text. Tweets come with a lot more data than that. Tweet object model: https://developer.twitter.com/en/docs/twitter-api/data-dictionary/object-model/tweet https://developer.twitter.com/en/docs/twitter-api/data-dicti... Example payloads: https://developer.twitter.com/en/docs/twitter-api/data-dictionary/example-payloads https://developer.twitter.com/en/docs/twitter-api/data-dicti...
- webo 4y ago
  Yeah, I was just highlighting how ignorant Musk is (sarcastically). This must’ve been what he meant by “hardcore software engineering.”
  - jmeister 4y ago
    Musk has one of the top AI researchers of his generation working for him(Karpathy). In general is rich enough to hire anyone he wants for consultation. I’m boggled by the extent to which people mind-read Musk through his tweets. To me it’s obvious that his Twitter is an outlet for stress busting and banter, like smoke breaks.
    - dubswithus 4y ago
      Karpathy is on sabbatical and rumored to be interviewing elsewhere.
      - naveen99 4y ago
        Hmm… with general AI around the corner, he should be getting paid more than steph curry.
  - Dylan16807 4y ago
    The example tweet, a somewhat large one with links and images, gzips down to 1.5KB by itself. Given that information, I think it would be reasonable to estimate 1KB per tweet in bulk. 500 million times 1KB is... still one USB stick, not even $50 https://amazon.com/SanDisk-512GB-Ultra-Flash-Drive/dp/B083ZLJ5MG/ https://amazon.com/SanDisk-512GB-Ultra-Flash-Drive/dp/B083ZL... Or going by the retweeted quote tweet that's 40% bigger zipped, it's still well within 1TB which is a normal size for a flash drive. I'm not very fond of Musk but this is a weak criticism.
    - croes 4y ago
      Not it isn't. It's not about storage but about analysing the data. It's text so it could easily be compressed to smaller size but this doesn't help in knowing anything about the tweet author, if he is a bit or not. That's like saying it's easy to check if a picture shows a bird because it's only 100kB.
      - Dylan16807 4y ago
        The tweet he replied to sure seemed to be about volume of data to me.

by webo 4y ago

deleted 4y ago

[deleted]

ceejayoz 4y ago

You can't do bot detection with just the tweet text. Tweets come with a lot more data than that. Tweet object model: https://developer.twitter.com/en/docs/twitter-api/data-dictionary/object-model/tweet https://developer.twitter.com/en/docs/twitter-api/data-dicti... Example payloads: https://developer.twitter.com/en/docs/twitter-api/data-dictionary/example-payloads https://developer.twitter.com/en/docs/twitter-api/data-dicti...

webo 4y ago
Yeah, I was just highlighting how ignorant Musk is (sarcastically). This must’ve been what he meant by “hardcore software engineering.”
- jmeister 4y ago
  Musk has one of the top AI researchers of his generation working for him(Karpathy). In general is rich enough to hire anyone he wants for consultation. I’m boggled by the extent to which people mind-read Musk through his tweets. To me it’s obvious that his Twitter is an outlet for stress busting and banter, like smoke breaks.
  - dubswithus 4y ago
    Karpathy is on sabbatical and rumored to be interviewing elsewhere.
    - naveen99 4y ago
      Hmm… with general AI around the corner, he should be getting paid more than steph curry.
- Dylan16807 4y ago
  The example tweet, a somewhat large one with links and images, gzips down to 1.5KB by itself. Given that information, I think it would be reasonable to estimate 1KB per tweet in bulk. 500 million times 1KB is... still one USB stick, not even $50 https://amazon.com/SanDisk-512GB-Ultra-Flash-Drive/dp/B083ZLJ5MG/ https://amazon.com/SanDisk-512GB-Ultra-Flash-Drive/dp/B083ZL... Or going by the retweeted quote tweet that's 40% bigger zipped, it's still well within 1TB which is a normal size for a flash drive. I'm not very fond of Musk but this is a weak criticism.
  - croes 4y ago
    Not it isn't. It's not about storage but about analysing the data. It's text so it could easily be compressed to smaller size but this doesn't help in knowing anything about the tweet author, if he is a bit or not. That's like saying it's easy to check if a picture shows a bird because it's only 100kB.
    - Dylan16807 4y ago
      The tweet he replied to sure seemed to be about volume of data to me.