3 ms·
The IT industry as a whole still hasn't quite internalised that servers now have dramatically worse I/O performance than the endpoints they are serving. For ex
by jiggawatts 2y ago
The IT industry as a whole still hasn't quite internalised that servers now have dramatically worse I/O performance than the endpoints they are serving.
For example, a project I'm working on right now is a small data warehouse (~100GB). The cloud VM it is running on provides only 5,000 IOPS with a relatively high latency (>1ms).
The laptops that pull data from it all have M.2 drives with 200K IOPS, 0.05ms latency, and gigabytes per second of read bandwidth.
It's dramatically faster to just zip up the DB, download it, and then manipulate it locally. This includes the download time!
The cheapest cloud instance that even begins to outperform local compute is about $30K/month, and would be blown out of the water by this new Samsung drive anyway. I don't know what it would cost to exceed 15GB/s read bandwidth... but I'm guessing: "Call us".
Back in the Good Old Days, PCs and laptops would have a single 5400 RPM drive with maybe 200 IOPS and servers would have a RAID at a minimum. Typically they'd have many 10K or 15K RPM drives, often with a memory or flash cache. The client-to-server performance ratio was at least 1-to-10, typically much higher. Now it's more like 10-to-1 the other way, and sometimes as bad as 1000-to-1.
- benlivengood 2y agoWhich cloud is $30K/month for 200K IOPS? GCE looks like it should be under $200/month for local SSD exceeding 200K IOPS for reads and writes. EC2 i3.xlarge looks about the same price and performance.
- jiggawatts 2y agoIs that persistent storage or just a “temp” disk?
- benlivengood 2y agoIt's as persistent as a laptop I'd say. GCP at least will live-migrate the data for maintenance events. Distributed consistent storage on top of local SSDs is 3x to 5x as expensive depending on your redundancy requirements in-region, another 2x that with regional replication. Fast IO is available cheaply in the cloud if you handle your own clustering.