3 ms·
You can get 32TiB of RAM instances on AWS these days
by physicsguy 9mo ago
You can get 32TiB of RAM instances on AWS these days
- RobinL 9mo agoExactly - these huge machines are surely eating a lot into the need for distributed systems like Spark. So much less of a headache to run as well
- jeffbee 9mo agoThat sounds damned near useless for typical data analysis purposes and I would very much prefer a distributed system to a system that would take an hour to fill main memory over its tiny network port. Also, those cost $400/hr and are specifically designed for businesses where they have backed themselves into a corner of needing to run a huge SAP HANA instance. I doubt they would even sell you one before you prove you have an SAP license. For a tiny fraction of the cost you can get numerous nodes with 600gbps ethernet ports that can fill their memory in seconds.
- akvadrako 9mo agoSeems they come with 200gbit ports so it takes 20 minutes to fill memory.
- mr_toad 9mo agoWhich is a lot for a single user, but when you have a dozens or hundreds of analysts who all want to run their own jobs on your hundred terabyte data warehouse then even the largest single machine wont cut it.