3 ms·

Show HN: Search over 100M archived posts and comments scraped from Parler

• throwaway888abc 6y ago
  Kudos to op / author for putting this out. >Please consider supporting this project so I can be more relaxed with server/bandwidth costs. Why not bittorrent (instead of expensive AWS S3) as any other datadump ?
  • formalsystems 6y ago
    Thank you! Agree 100% on bittorrent - in all honesty I am new to these kinds of projects, and the wonderful people of the Internet like yourself have been really helpful in showing me the standard way to go about things. Should be a torrent link on there by tomorrow!
    • nagyf 6y ago
      S3 actually supports Torrent: https://docs.aws.amazon.com/AmazonS3/latest/userguide/S3Torrent.html https://docs.aws.amazon.com/AmazonS3/latest/userguide/S3Torr... It might be the easiest solution for you
      • cosmodisk 6y ago
        I'm impressed that AWS supports torrent, however that won't reduce S3 hosting costs, as each new download would only increase it.