3 ms·
The world of servers has changed a lot in the recent past. Hardware complexity has exploded because now you have to use custom chips to be competitive: DPUs ca
by rlupi 4y ago
The world of servers has changed a lot in the recent past.
Hardware complexity has exploded because now you have to use custom chips to be competitive: DPUs can accelerate data proccesing pipelines, large GPU clusters or custom chips like Google's TPU are necessary for very large ML training, CPU+GPU in the same package like Grace Hopper for (some) HPC. The number of new product introductions grows. If you have workloads that need a mix of these, for all but the companies with the deepest pockets, running your own datacenters becomes an exhausting Red Queen's race.
Not to mention the increasing fragmentation in privacy and regulations that can impose geographic restrictions for data. It's not a issue for Uber, but it can be for anyone offering B2B services in some markets.