3 ms·

> The tool costs 10c per million tokens for Lama 3.1 8B and 60c per million tokens for Llama 3 70B or roughly around 1/5 the price of GPU solutions. but how mu

> The tool costs 10c per million tokens for Lama 3.1 8B and 60c per million tokens for Llama 3 70B or roughly around 1/5 the price of GPU solutions. but how much to purchase the chip itself?

allears 2y ago
You don't buy it, you rent access to it. They want to market it as more of a service than a product.
wmf 2y ago
A few million.