3 ms·
It doesn’t have full feature parity, but as the post you shared says, they “aim for full interoperability with S3”. If you have an S3 client doing basic object
by blowski 3y ago
It doesn’t have full feature parity, but as the post you shared says, they “aim for full interoperability with S3”. If you have an S3 client doing basic object storage stuff, it will work fine with Spaces.
- dijksterhuis 3y agoEh, not Apache Spark <--> Spaces. Doesn't work out the box unlike Spark <--> AWS S3. See other child comment above. Faster to use AWS S3 instead of trying to fix it (IIRC can't set the endpoint url or something, which is required for Spaces). :shrug:
- blowski 3y agoI appreciate I'm making a "No True Scotsman" point, but Spark isn't really "a typical S3 client doing basic object storage stuff". I'm thinking of your standard web app persisting uploads and static files.