4 ms·
According to this tweet, Llama 3 costs about $0.20 per Million tokens using an M2. https://x.com/awnihannun/status/1786069640948719956 https://x.com/awnihannun
by itake 2y ago
According to this tweet, Llama 3 costs about $0.20 per Million tokens using an M2.
https://x.com/awnihannun/status/1786069640948719956 https://x.com/awnihannun/status/1786069640948719956
In comparison, GPT3.5-turbo costs $0.50 per million tokens.
Do you think an old iPhone will less than 2x efficient?
- nightski 2y agoFWIW depends on cost of power. Where I live cost of power is less than half the stated average.