4 ms·
Edge TPUs are low cost, low power inference devices the size of a dime. I have a hundred of them sitting in a closet. (Alas. Anyone want to buy 100 coral minis?
by dgacmu 3y ago
Edge TPUs are low cost, low power inference devices the size of a dime. I have a hundred of them sitting in a closet. (Alas. Anyone want to buy 100 coral minis? :-)
The TPUs you rent that are being discussed here are capable of training, consume hundreds of watts and have a heatsink bigger than your fist and really spectacular network links. They're analogous to Nvidia's highest end GPUs from a "what can you do with them" perspective.
Both are custom chips for deep learning but they're completely different beasts.
- fragmede 3y agoCan I hook a microphone up to a Coral Mini and run Whisper? I'd love to have a home assistant that wasn't on the cloud. As for the rest of them, list them on Amazon and let them do the fulfillment. That $10k of hardware isn't going to sell itself from your closet. (Yet. LLMs are making great strides.)
- dgacmu 3y agoIt has a microphone built in. And that's a good idea, thanks. I've been dreading the idea of using ebay.