4 ms·
This project is literally aiming to run on devices like old phones. I don't think having an old phone is particularly entitled. I think casually slapping down
by wokwokwok 2y ago
This project is literally aiming to run on devices like old phones.
I don't think having an old phone is particularly entitled.
I think casually slapping down $100 on whim to play with an API... probably, yeah.
/shrug
- itake 2y agoAccording to this tweet, Llama 3 costs about $0.20 per Million tokens using an M2. https://x.com/awnihannun/status/1786069640948719956 https://x.com/awnihannun/status/1786069640948719956 In comparison, GPT3.5-turbo costs $0.50 per million tokens. Do you think an old iPhone will less than 2x efficient?
- nightski 2y agoFWIW depends on cost of power. Where I live cost of power is less than half the stated average.