4 ms·
If you’re honestly asking if accessing s3 exclusively through SFTP is a good idea (regardless of if it somehow makes you magically cloud agnostic), I really rea
by orf 4y ago
If you’re honestly asking if accessing s3 exclusively through SFTP is a good idea (regardless of if it somehow makes you magically cloud agnostic), I really really don’t know what to say. Other than “no”.
I’m reminded of a quote by Babbage
> I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question
- wizofaus 4y agoCan you give an example of something that wouldn't work well if you did so? I've written code to talk to both sftp and s3 servers, the basics aren't that different...
- orf 4y agoListing prefixes, signed URLs, tags/metadata, throughput and of course latency. The S3 API is pretty standard a number of open source projects and cloud providers use it. But the whole question smells funny. It’s much better in almost all regards to abstract over a storage interface in code rather than use something like SFTP.
- wizofaus 4y agoGranted on signed URLs - you'd need a vendor-specific extension to generate one I suppose. Not sure why throughput/latency should be worse with sftp. And yes, I've done the abstraction thing in the past too - unfortunately the code base I'm currently working with doesn't, meaning you can't run it fully without an actual connected aws environment. I'm not suggesting sftp is the right choice, just wondering how feasible it is to make use of existing open protocols to access cloud-based services.
- orf 4y agoYou need to understand that the S3 API is an open protocol. It’s a simple, well documented HTTP API of which there are many open source implementations. Minio is one of the well known ones. It’s not some closed, custom binary protocol.
- wizofaus 4y agoThanks, I actually wasn't aware of that. Do other cloud providers support it? Will look into minio as an option for running s3 locally.