6 ms·
I’m at a FAANG and we have $300/day token quota. Personally I don’t use that much of it but management is pushing really hard for it. “the quota has been raised
by wrxd 5mo ago
I’m at a FAANG and we have $300/day token quota. Personally I don’t use that much of it but management is pushing really hard for it. “the quota has been raised for a reason, use it”. Any task: “have you tried working on it with Claude?”. Every meeting “now engineer x and y will show you what he did with AI”.
It’s not all useless but most of the days I think I would be more productive if some processes were streamlined rather than if I had to throw tokens at them and still fail.
Of all the showcases I’ve seen the best are the ones written by people assuming that the token bonanza will not last so they used AI to build tools they wished they had. AI used to build the tool but by no means used by the tool, so if/when token quota gets reduced we still have a functional tool.
- utopiah 5mo agoInnovation signalling.
- solenoid0937 5mo agoAlso at a FAANG here. Surprised you don't manage to use $300 in a whole day. It's almost trivial to productively use that much in under an hour. Leadership is not being dumb, at least on this topic. If your token usage is that low, you just aren't using AI that much (even if you think you are.)
- haneul 5mo agoHow are you able to get to $300/hr productively? (I’m assuming this isn’t fast mode tax).
- blazespin 5mo agonot hard, massive elo stuff. every decision point needs to think up and implement 25 ideas and then rank them.
- denkmoon 5mo agoI use $30 a day to produce a decent amount of code. Certainly more than we need - thinking about/designing the correct solution/distilling requirements is still the bottleneck. How can you possibly even review $300/day worth of output?
- zomglings 5mo agoIt doesn’t have to be $300/day worth of output tokens. It could be like $290/day worth of input tokens to teach both you and the model about the problem you are solving and then $10/day worth of output tokens.
- skydhash 5mo agoAnd what about you knowing the problem and the solution, but are just worrying about the impact downstream. Most of my time is spent managing those. I know the exact code to be published. And some time I already have it committed in my local branch. Then you need to make everyone aware of what it entails and that's usually how you can spend days on a simple bug or a change request. Software is a big graph of interlocked rules. And if you can grasp the whole or the part you own (and you should be able to), it's often very easy to see the control points. You don't have a coding bottleneck anymore, you have a communication bottleneck[0]. Which is an organizational issue, not anything relevant to engineering. [0]: See Naur's Programming as Theory Building and Brooke's Mythical Man Month.
- est31 5mo agoIf you give it $290 of input tokens for $10 of output tokens, you are doing something wrong. I.e. you paste the whole CI output into the prompt instead of giving it a link to the file, and then the AI greps its way through it (using a fraction of the tokens). Sometimes AI overdoes things and it re-runs the whole testsuite because the tail command didn't have enough lines, but the other way round messes up the context so much so that in the end all that context is useless.
- seanmcdirmid 5mo agoIt could be thinking tokens or tokens passed in via RAG.
- kortilla 5mo agoIf you are burning through $2400 a day, you’re just wasting tokens on idiotic tasks.
- k4rli 5mo agoHe's rewriting Bun from Rust to Python now.
- Sharlin 5mo agoDo you even realize how insane your comment is? "If you aren't donating at least your salary's worth of company money to another company every day, are you even working?"
- solenoid0937 5mo agoUsed to think exactly like you. That's why I know you all will "get it" eventually. Most companies and orgs are just so far behind the curve.
- mrits 5mo agoYou might want to put this statement in your AI and ask if it was logically sound
- solenoid0937 5mo agoOf course it's logically sound. The AI skepticism crowd is trying to tell me the reality I see before my very eyes and work with every day simply does not exist. I know for sure that reality exists, and that they will either catch up or be left behind. Don't really need to explain myself beyond this.
- expedition32 5mo agoWhat's more likely is that you are rationalising your religion. Some people break their conditioning others don't.
- desdenova 5mo agoBelieving something to be real that isn't is basically what psychosis means.
- Imustaskforhelp 5mo agoI do find it quite ironical that the thread is about the fact that Mitchell states that there are entire companies right now under AI psychosis and then we see solenoid's comments and they do seem to prove a few part of it. Hackernews acts like a great litmus test indeed.
- mancerayder 5mo agoWouldn't they save an enormous amount of money by getting rid of either you and the token quota, or a bunch of other people to continue paying your salary plus this insane quota?
- Miner49er 5mo agoHow? I struggle to use the 1000 Kiro tokens I get a month, and that only costs $20. And I use it more then anyone else on my team. Maybe we're just massively behind?
- sumeno 5mo agoI am glad I am not on your team, the amount of slop they have to deal with coming from you must be overwhelming
- upcoming-sesame 5mo ago300 an hour, that's insane
- peab 5mo agoNot really, if you use the most expensive models and you have a large codebase stuffed into the context window
- eaglelamp 5mo agoAlso you regarding Claude usage limits: > Before the doomers come in, you get $200 in API credits every month for claude -p usage. Usage counts against those API credits. So which is it $300/day is trivial to consume or $200/month is a completely reasonable limit, it can't be both.
- Drupon 5mo ago[flagged]
- never_inline 5mo agoYou must be using a really bad harness or just writing very vague prompts. 20 Million tokens is a lot.
- nfRfqX5n 5mo agoSeems like people are spending more time building tools than doing actual work. Lots of overlap too
- johnnyanmac 5mo agoIn all fairness, doing actual work in this current slice of time is not what componies are prioritizing as of now.
- ex-aws-dude 5mo agoThat’s funny I’ve been doing that too Trying to crank out all the tools I never had time to build because I think we’re going to get cut off eventually
- hosteur 5mo agoMay I ask what tools did you make so far? And what is on your roadmap?
- WickyNilliams 5mo agoNot OP, but I've been focusing on linting and automation. Custom lint rules to encode best practices that previously relied on astute/alert code reviewer to call attention to. This is handy not just for humans but it steers the bots too. Or turning on some existing rule that required a big cleanup/migration to be compliant with. Now I just throw an LLM at it, since they're often laborious but mechanical changes. Which is the sweet spot for an LLM. Also automating everything I can. That annoying release process that everyone hates but wasn't quite long/arduous enough to justify the time before? It's now automated. GitHub workflows for all the things. This kind of stuff will forever be useful, even if the bottom drops out and the bubble bursts. And none of it is reliant on AI to run
- caarmen 5mo agoNot OP, but a very simple example: I use AI to review my work before opening a PR for my colleagues to review. I ask it to review the commits in my branch. Instead of consuming tokens just to instruct it how to use git operations and other tools to find the commits since the base commit, I asked AI to create a little bash script to make patch files commit1.patch, commit2.patch, commit3.patch, etc, for all the commits in my branch since the base commit. Now I just use this script to prepare the context of commits to review. I feel like an imposter here, I’m definitely not using AI as much as it seems everyone is :( I can’t imagine using hundreds of dollars of tokens a day. But maybe this little tip for reviews might be helpful to someone.
- capitol_ 5mo ago
- mancerayder 5mo ago300 a day?? 7K dollars a month? No wonder they need to lay people off!
- delecti 5mo agoWell, presumably (hopefully) they aren't expected to work weekends.
- ruraljuror 5mo agoNo days off for the agents.
- chezelenkoooo 5mo agoYes, the cost of AI is a big contributing factor.
- Conscat 5mo agoAt Nvidia, we have no limit for Anthropic or Open AI models (for now) and are heavily encouraged to use them as much as possible.
- checker659 5mo agoPlease don’t tell me you’re writing RTL
- Conscat 5mo agoI'm not, I work higher level products. I've talked to a few people who do but I don't recall if they have different standards.
- mindv0rtex 5mo agoThe fact that they've started promoting using the Caveman mode tells me that the unlimited usage policy is taking its toll.
- nojs 5mo ago> $300/day token quota Are companies using per-token billing? Why - is there some reason they can’t buy the $200/mo Claude plan for every employee?
- novaleaf 5mo agoMax 20x is for individuals only. (could probably have emps get it themselves, and reimburse)
- nl 5mo agoIF they do individual billing the business doesn't get token reporting
- Our_Benefactors 5mo ago> could probably have emps get it themselves, and reimburse They can’t track token use this way. Also it’s a massive violation of the model providers TOS.
- Toutouxc 5mo agoHuh? I believe it’s completely fine for a company to pay for regular Claude subscriptions for employees, as long as they don’t share logins.
- pixel_popping 5mo agoNot fine as per the ToS.
- Toutouxc 5mo agoI can't find anything in the ToS that it would go against. I even asked Claude to check its own ToS and tell me if it's okay.
- 5mo ago
- daniel3303 5mo ago"AI used to build the tool but by no means used by the tool" is a really good way to put it. Feels like the smart play right now is treating these credits as temporary subsidy and building stuff that still works when the bill comes due.
- throwa356262 5mo agoIt is fairly easy to tokenmax by having and inefficient automation set up. Not something I would do personally. But it is surprisingly easy to set up a claw that eats half of your token budget in a meaningless "research" task. Set it up as a cron job and you will soon be promoted for being an AI visionary
- ksec 5mo ago>we have $300/day token quota. Unless other FAANG have the exact amount this is going to be Apple. And no wonder why the quality of Apple software has gone downhill. Apple in software development and design used to be very conservative. BSD like. Especially the lower end of the stack. Now it is no different to other Silicon Valley companies.
- riponcm 5mo ago[flagged]
- JessieJanie 5mo agoHow do you even use that much daily?
- samuelarogbonlo 5mo agoI have an unrelated question, please. I am trying to make a post and get this error: "Sorry, your account isn't able to submit this site.", you know why or have a solution for it?