4 ms·

is this a cpu that's meant for AI training or is it more for serving inference? I don't quite get why I would want to buy an arm CPU over a nvidia GPU for ai ap

is this a cpu that's meant for AI training or is it more for serving inference? I don't quite get why I would want to buy an arm CPU over a nvidia GPU for ai applications.

deleted 7mo ago
[deleted]
Azantys 7mo ago
It is for orchastrating inference/creating firecracker instances for agents etc. It does'nt have anything to do with actual AI usage.
- vsgherzi 7mo ago
  Interesting thanks