5 ms·
S3 is the simplest CRUD app you could create. It's essentially just the 4 functions of C.R.U.D done to a file. Most problems in tech are not that simple. Not
by alberth 2y ago
S3 is the simplest CRUD app you could create.
It's essentially just the 4 functions of C.R.U.D done to a file.
Most problems in tech are not that simple.
Note: not knocking the service. just pointing out not all things are so inherently basic (and valuable at the same time).
- riv991 2y agoIsn't that the most impressive part? That the abstraction makes it seem so simple
- bdcravens 2y agoThat's the public interface. The underlying architecture is where the power is.
- cruffle_duffle 2y agoThat’s when you really know you hid all the complexity well. When people call your globally replicated data store with granular permissions, sophisticated data retention policies, versioning, and manage to have, what, seven (ten?) nines or something, “simple”. No problem. I’m sure ChatGPT could cook up a replacement in a weekend. Like Dropbox it’s just rsync with some scripts that glue it together. How hard could it possibly be? I mean people serve entire websites right out of s3 buckets. Using it as a crude CDN of sorts. It’s a modern marvel.
- sebastiansm 2y agoI could build a netflix in a weekend.
- golly_ned 2y agoA file system is simple. Open, read, close. Most tech problems are not that simple. How hard could a filesystem be?
- dekhn 2y agoLocking, checks after unclean shutdown, sparse files, high performance, reliabilty.... are all things that make filesystems harder.
- szundi 2y ago[dead]
- snoman 2y agoYou’ve either never implemented a file system, or just a basic POC of one that nobody used.
- marsovo 2y agoErm, most file systems allow you to change data too, right? Hence S3 is emphatically not a file system.
- shepherdjerred 2y agoAnyone can create a CRUD API. It takes a _lot_ of work to make a CRUD API that scales with high availability and a reasonable consistency model. The vast majority of engineers would take months or years to write demo. If you don't believe me, you might want to reconsider how skilled the average developer _really_ is.
- o10449366 2y ago[flagged]
- rglover 2y agoI used to have the same opinion until I built my own CDN. Scaling something like that is no joke, let alone ensuring you handle consistency and caching properly. A basic implementation is simple, but at S3 scale, that's a whole different ball game.
- icedchai 2y agoNow add versioning, replication, logging, encryption, ACLs, CDN integration, event triggering (Lambda). I could go on. These are just some other features I can name off the top of my head. And it all has to basically run with zero downtime, 24x7...
- jimbokun 2y agoThe point of the article is that making a service at S3's scale with such a simple API exposed to the end user, without exposing the provisioning and durability and security and performance to make it all work... ...is very difficult.