3 ms·
it does seem very likely that $ per token of inference (at fixed quality) will continue to go down rapidly as hardware and software continues to improve.
by adgjlsfhk1 2y ago
it does seem very likely that $ per token of inference (at fixed quality) will continue to go down rapidly as hardware and software continues to improve.