4 ms·
Is 4 TPS actually useful for anything? That's around 350,000 tokens in a day. I don't track my Claude/Codex usage, but Kilocode with the free Grok model does a
by nl 10mo ago
Is 4 TPS actually useful for anything?
That's around 350,000 tokens in a day. I don't track my Claude/Codex usage, but Kilocode with the free Grok model does and I'm using between 3.3M and 50M tokens in a day (plus additional usage in Claude + Codex + Mistral Vibe + Amp Coder)
I'm trying to imagine a use case where I'd want this. Maybe running some small coding task overnight? But it just doesn't seem very useful.
- zarzavat 10mo ago3.5-50M tokens a day? What are you doing with all those tokens? Yesterday I asked Claude to write one function. I didn't ask it to do anything else because it wouldn't have been helpful.
- KronisLV 10mo agoHere’s my own stats, for comparison: https://news.ycombinator.com/item?id=46216192 https://news.ycombinator.com/item?id=46216192 Essentially migrating codebases, implementing features, as well as all of the referencing of existing code and writing tests and various automation scripts that are needed to ensure that the code changes are okay. Over 95% of those tokens are reads, since often there’s a need for a lot of consistency and iteration. It works pretty well if you’re not limited by a tight budget.
- nl 10mo agohttps://github.com/nlothian/Vibe-Prolog https://github.com/nlothian/Vibe-Prolog chews a lot of tokens. Have a bunch of other side projects as well as my day job. It's pretty easy to get through lots of tokens.
- SamDc73 10mo agoI only run small models (70b at my hardware gets me around 10-20 TOPS) for just random things (personal assistant kind of thing) but not for coding tasks. For coding related tasks I consume 30-80M tokens per day and I want something as fast as it gets