4 ms·
I've been looking at these a possible Mac Studio competitor for prosumer inferencing but the current models on the market are not attractive for this purpose.
by faeriechangling 3y ago
I've been looking at these a possible Mac Studio competitor for prosumer inferencing but the current models on the market are not attractive for this purpose. Expect the model being advertised here to be available to own for quite awhile.
I do sort of think this is where things are going to be headed though for inferencing - massively parallel DDR memory and a fast ARM cpu. GDDR and HBM based solutions just seem to cost too much.