3 ms·
being 6 orders of magnitude off in your cost calculation isn't great. groq costs about that for llama 3 70b (which is a monumentally better model) and 1/10th o
by jasonjmcghee 2y ago
being 6 orders of magnitude off in your cost calculation isn't great.
groq costs about that for llama 3 70b (which is a monumentally better model) and 1/10th of that for llama 3 8b
- pants2 2y agoGroq doesn’t currently have a paid API that one can sign up for.
- jasonjmcghee 2y agoYup. True. Should say "will" - currently free but heavily rate-limited. Together AI looks to be about $0.30 / 1M tokens, as another price comparison. Which you can pay for.