3 ms·

Hi! Congratulations on GA! Been waiting for this. I just heard about AWS CRT at the AWS ReInvent Innovation talk on Storage. 1. Does the Rust SDK use CRT unde

Hi! Congratulations on GA! Been waiting for this. I just heard about AWS CRT at the AWS ReInvent Innovation talk on Storage. 1. Does the Rust SDK use CRT under the hood? I use the Rust SDK to access S3 and wonder if there are any automatic performance gains? 2. I couldn't find good material on how AWS CRT works and how it is integrated with the Java or Python S3 connectors. I would appreciate a more technical explanation. Do you have any links that explains this in more depth?

rusbus 3y ago
The Rust SDK does not currently use the CRT under the hood. The CRT is a high performance C-Library for fast HTTP connections (and a lot more). For S3, there is a meta-layer that interceps requests to S3 and converts them into ranged-gets and multipart uploads for parallelization. It's quite complex and can also use significantly more memory, but it does allow for *much* faster uploads and downloads in some circumstances.