I think llms are useful when you're trying to write something in a language you don't know well; then it speeds up the part where you need to check for simple i

I think llms are useful when you're trying to write something in a language you don't know well; then it speeds up the part where you need to check for simple idiosyncrasies. If you don't know the language at all it's dangerous because you may not understand the proposed program (and of course if you're an expert you don't need it at all). But llms won't help to find solutions to a general, still unspecified problem.