3 ms·
How do you access a file that large? Presumably you don't have to stream it from S3 to EC2 in its entirety in order to do computations with it. Does that mean y
by gruseom 16y ago
How do you access a file that large? Presumably you don't have to stream it from S3 to EC2 in its entirety in order to do computations with it. Does that mean you can have random access into it in order to work with a chunk at a time?
- amock 16y agoYes. "For example, you could stream terabytes of data off of a genomic sequencer as it is being created, store the final data set as a single object and then analyze any subset of the data in EC2 using a ranged GET"
- btn 16y agoS3's REST API supports the HTTP 'Range' header to pluck bits of an object out (with a similar facility in its SOAP API).