4 ms·
The way some people wield LLM, etc is like using a chainsaw to cut a dovetail because it is faster.
by burntoutgray 7mo ago
The way some people wield LLM, etc is like using a chainsaw to cut a dovetail because it is faster.
- snek_case 7mo agoYou're definitely going to get people using LLMs running on 8x $50K GPUs in a datacenter to do the job of a bash script.
- edgyquant 7mo agoI already see people using an agent to write a git commit
- derwiki 7mo agoWhat’s wrong with that? The agent session had all the business context, knows what changed, and how we verified it. It takes 5s to turn that into a PR desc vs 10-100x that by hand
- maplethorpe 7mo agoBecause it's not perfect and it still fabricates things from time to time. I have coworkers who do this and it sucks to be on the receiving end of. It means I now need to read every commit message with skepticism. It's an example of using AI to save energy for yourself while simultaneously increasing the energy expenditure of your coworkers.
- gibbitz 7mo ago100 x 5s is nearly 10 minutes. If it takes 10 minutes to write a PR there may be a "skill issue". The bottom end of this 1-2 minutes makes more sense. How much productivity do we really need? Even at senior dev payscale 2 minutes is like a dollar. The tokens and calls involved in having a 5s commit could close in on 10¢, depending on your contract, the model etc. and that's today's costs. Do remember that my salary is on top of the rates for the LLM, so if the 5s response takes 5s for me to prompt, that's 15s (10 for me 5 for the LLM) that the boss is paying for. This starts to feel like a billionaire eating ramen noodles just so he can reach his second billion dollars. Where I work our contract limits API calls, so doing this could result in not being able to use the model when I need it later for something more sophisticated (planning, debugging etc.) than using tooling I'm paid to already know.
- edgyquant 6mo agoIm not even talking about the description but “commit this to git with the description x” type prompts
- robocat 7mo agoI figured there must be a mix of dovetails and chainsawing: beautiful: https://dovetailcabintools.com/videos https://dovetailcabintools.com/videos