5 ms·
It'll be really hard to measure this because you can't easily isolate the impact of LLMs vs all the economy. I guess anything at all will overshadow LLMs number
by gtirloni 2y ago
It'll be really hard to measure this because you can't easily isolate the impact of LLMs vs all the economy. I guess anything at all will overshadow LLMs numbers (e.g. tiny changes in Fed interest rates having more impact on job posts than LLMs ever will).
I only have anecdata to share. My coworkers and friend seem to be going through the disillusionment phase and finding LLMs as a better (if mildly outdated) search engine and a helper for simple well-known tasks. I guess the 10% productivity improvement makes sense from what I've seen.
I've also met company owners that thought they could reduce their workforce drastically because of LLMs. I can only wish them good luck, it's going to be bumpy for them once they realize the mess they will be in (e.g. spending more time troubleshooting systems their engineers never understood in the first place).
TL;DL; No, except for places you wouldn't want to work at.
- itsoktocry 2y ago>(e.g. spending more time troubleshooting systems their engineers never understood in the first place). I do not, for one second, believe that any company is literally cut-and-pasting code straight out of ChatGPT into their production environments without their engineers understanding it. The number of developers on HackerNews who think that not using LLMs is "cool" or more valuable is shocking. It's no different than saying you don't use X other development tool.
- mlcruz 2y ago> I do not, for one second, believe that any company is literally cut-and-pasting code straight out of ChatGPT into their production environments without their engineers understanding it. I would guess that close to 10% of the codebase at my company is straight up copy pasted from ChatGPT without further thought.
- azdle 2y agoI love your idealism, but allow me to be your data point. The place where I work just fired our CTO because he was doing exactly that, to "speed up" the software team, after I complained to other execs that this was massively slowing us down because of all the time we spent trying to figure out what the nonsense code he was shotgunning into main was supposed to do. (Not the only reason, I'm told.)
- gtirloni 2y ago> I do not, for one second, believe that any company is literally cut-and-pasting code straight out of ChatGPT into their production environments without their engineers understanding it. It routinely happens with StackOverflow answers to the point of being a meme. LLMs are just the next iteration.