emasquil

4 ms·

1. 1.▲
   A principled way to solve problems(emasquil.github.io)

   140 points by emasquil 4y ago|23 comments
2. 2.▲
   by emasquil 5y ago

   Sorry about that! Next time I work on my blog I'll take that into account and find a better theme/color palette. In the meantime you can change it to light mode (clicking on the top right button) and there you have black text on w
3. 3.▲
   by emasquil 5y ago

   I just mentioned the issue because a colleague of mine did some quick tests with aioboto3 and he told me it was downloading the files sequentially. We thought it might be related to that. You made a great point about going async if you need
4. 4.▲
   by emasquil 5y ago

   Unfortunately I haven't. If someone wants to benchmark this solution I'd be glad to hear about that!
5. 5.▲
   by emasquil 5y ago

   In this case I needed to download about 1k files of size ~ 10mb. Doing this with multithreading was so much faster than downloading all the files sequentially.
6. 6.▲
   by emasquil 5y ago

   In this case I just wanted to keep it simple and do it the "native" way. I've been hearing a lot about aioboto3 and I'll surely check it out. However, it seems to have some limitations like https://github.com&
7. 7.▲
   Downloading files from S3 with multithreading and Boto3(emasquil.github.io)

   154 points by emasquil 5y ago|64 comments