4 ms·
Ask HN: If you're burning tokens at scale, what are you using them for?
I know lots of people use tokens to run coding agents, but I'm interested in hearing from people who are burning large amounts of tokens on automated tasks that aren't driving some kind of agent.
Do you have processes set up that are e.g. processing documents, audio, or video files? Particularly interested in hearing from people doing this in a business context.
- dxbhack 2mo agoWe process a lot of business documents at scale, invoices, sales orders, insurance documents and so on. Our token usage easily go beyond 50 to 100 million tokens per day. We use a routing approach where simpler tasks go to smaller, cheaper models and more complex tasks go to frontier models. We are also working on having our own model for some of these workloads. Document processing is probably one of our biggest agent use cases for tokens at this scale.
- akudha 2mo agoInterested in this kind of work. How did you get into this niche?
- kingkongjaffa 2mo agoIs this through LLM providers on a metered API connection? You're probably at the scale that having your own hardware to run local models is worth it, even if it's a couple of mac minis or mac pros in a cupboard in your office.
- dxbhack 2mo ago[dead]
- toomuchtodo 2mo agoSoftware vulnerability assessments, constructing and testing attack chains via a vulnerability testing factory.
- qqrun 2mo ago[flagged]
- wybaby168 2mo ago[flagged]
- Ilia21489 2mo ago[flagged]