3 ms·
(Not affiliated with Cerebrium, just did a bit of looking into this a little while back). Runpod outsources much of their infrastructure to small players that
by Sanzig 1y ago
(Not affiliated with Cerebrium, just did a bit of looking into this a little while back).
Runpod outsources much of their infrastructure to small players that own GPUs. They have recently added some requirements on security and reliability (eg: some level of security audit such as SOC 2, has to be hosted in a real DC, has to be in a locked rack), but fundamentally they are leaning on small shops that slap some GPUs in a server at a colocation facility. This personally would make me nervous about any sensitive workloads.
My impression is that Cerebrium either owns their own GPU servers or they're outsourcing to one of the big players. They certainly don't have the "partner program" advertised on their site like Runpod does.