4 ms·

Wouldn't the cost of transferring the crawled data (compressed/archived) to AWS/EC2 partially offset the cost saving? Edit: AWS still has free imbound BW.. my

• brey 14y ago
  nice thing about running crawlers from EC2 - all inbound bandwidth is free
  • zerop 14y ago
    Like running crawlers what can be some other use cases where free inbound is a blessing?
    • bigiain 14y ago
      Backup/archive, where uploading data is frequent and downloading it is only very occasionally required.
• jdrock 14y ago
  No - inbound data transfer cost to AWS is free.