3 ms·
The ability to take Jetson cards is actually a really strong point in its favor IMO. Raspberry Pis by themselves aren't incredibly interesting in clusters excep
by spijdar 5y ago
The ability to take Jetson cards is actually a really strong point in its favor IMO. Raspberry Pis by themselves aren't incredibly interesting in clusters except for pedagogical reasons, but with some Nvidia cards running whatever on CUDA, maybe with some RPis mixed in to do management/support tasks, and the built-in BMC, this could be pretty sweet for the right task.
- bayesian_horse 5y agoI'm not sure these NVidia cards are very powerful. One decent GPU in a PC may blow several clusters of these out of the water. I haven't checked, though.
- spijdar 5y agoIn raw performance, probably. The benefit these have (at least purportedly) is they're very energy efficient, consuming little power (and generating little heat) for comparatively large throughput. So I can imagine someone wanting a few of these on a desk, running inference on some models or something, maybe as a small back-end for a hobby project. It may still be more power efficient to just use regular GPUs, but I suspect these win out because of the tight coupling between "CUDA cores" and the CPU. Now, is that worth spending a bunch (many hundreds) of dollars on a carrier board and these Jetson modules? For me, no, but I at least see why it may appeal to some people.