3 ms·
Just in time, I've been needing to implement s3 upload asynchronously.
by djha-skin 4y ago
Just in time, I've been needing to implement s3 upload asynchronously.
- PyWoody 4y agoAre you sure it's worth the complexity? Threads will drop the GIL for the duration of the network bound I/O .
- djha-skin 4y agoGood point!
- xtreak29 4y agoDoes aioboto3 help here? https://aioboto3.readthedocs.io/en/latest/usage.html#upload https://aioboto3.readthedocs.io/en/latest/usage.html#upload
- RantyDave 4y agoI did it through 'multiprocessing' and a Pipe. Works fine but challenging shutting everything down when the child process throws an exception.