3 ms·
Is there anyway to use Google's Coral TPU PCIe Accelerator[1]'s to increase the inference performance of GPT models like this and Llama? [1] https://coral.ai/p
by technerder 4y ago
Is there anyway to use Google's Coral TPU PCIe Accelerator[1]'s to increase the inference performance of GPT models like this and Llama?
[1] https://coral.ai/products/pcie-accelerator/ https://coral.ai/products/pcie-accelerator/
- tempaccount420 4y agoSupposedly TPUs are better than GPUs, but everyone other than Google uses GPUs for models.