4 ms·
I have not gotten good numbers on the real inference costs, its kind of annoying. Most comparisons are with the API costs, where we have no idea how profitable
by rileymat2 20d ago
I have not gotten good numbers on the real inference costs, its kind of annoying. Most comparisons are with the API costs, where we have no idea how profitable it is.