3 ms·
Hardly. 1) Coral Edge TPU chip has 8 MB SRAM; for comparison, Whisper Tiny (https://huggingface.co/openai/whisper-tiny https://huggingface.co/openai/whisper-ti
by krasin 3y ago
Hardly.
1) Coral Edge TPU chip has 8 MB SRAM; for comparison, Whisper Tiny (https://huggingface.co/openai/whisper-tiny https://huggingface.co/openai/whisper-tiny) is 40M parameters, and most of LLMs have billions of parameters.
2) I would be surprised if Coral Edge TPU supports all TensorFlow ops required to run Transformers. The chip was designed with convolutional networks in mind.