3 ms·
Cost decreases with time Humans can work on a problem 8 hours a day? You can run inference 24/7
by shdh 1y ago
Cost decreases with time
Humans can work on a problem 8 hours a day? You can run inference 24/7
- charcircuit 1y agoIt decreases, but decreasing from $1 million per token to $0.9 million per token after a year is still a decrease, but it still is not viable. Paying an AGI a $100 billion dollars for it to work 24/7 for a year is worse than hiring 10 people for $30k a year to work shifts to do the same work 24/7.