I was curious as to whether this indeed would be possible. But the CPU (W-3275M) itself starts at $6k, the Vega's are $8k each, I can't find any catalogue price

I was curious as to whether this indeed would be possible. But the CPU (W-3275M) itself starts at $6k, the Vega's are $8k each, I can't find any catalogue prices but each slab of ram comes in at around $600 which puts us at $30k. Not unthinkable that the remaining hardware can add another $5k to the bill and you're looking at a $35k machine. You can probably replace some of these with consumer grade parts, but I'll be impressed if you can create a machine with two titans, 28 cores, and 1.5tB of memory for under $10k.