LLMs are great for simple, common, boring things. As soon as you have something less common, it will give you widely incorrect garbage that does not make any s

LLMs are great for simple, common, boring things. As soon as you have something less common, it will give you widely incorrect garbage that does not make any sense. Even worse, it APPEARS correct, but it won’t work or will do something else completely. And I use 4o and o1 every day. Mostly for boilerplate and boring stuff. I have colleagues that submit ChatGPT generated code and I’ll immediately recognize it because it is just very bad. The colleague would have tested it, so the code does work, but it is always bad, weird or otherwise unusual. Functional, but not nice. ChatGPT can give very complicated solutions to things that can be solved with a one-liner.