3 ms·
AFAIK Google Coral is an inexpensive TPU you can buy right now: https://coral.ai/products/accelerator/ https://coral.ai/products/accelerator/
by jmrm 3y ago
AFAIK Google Coral is an inexpensive TPU you can buy right now: https://coral.ai/products/accelerator/ https://coral.ai/products/accelerator/
- worldsayshi 3y agoVery cool! Although seems to have no memory to speak of so many use cases like LLM goes away because of that I guess?
- muxamilian 3y agoIt has 8 MB of memory. It also supports live streaming the neural network to the chip, although that is slower than when it is cached in the memory.
- kmeisthax 3y agoThe problem is that this is an "inferencing" accelerator - i.e. it can only execute pretrained models. You cannot train a model on one of these, you need a training accelerator. And pretty much all of those are either NVidia GPUs or cloud-only offerings.