I have, hence my perspective. For boiler plate and solved problems, it can do ok. However, anytime it needs to do something novel it will be hit and miss, usual

I have, hence my perspective. For boiler plate and solved problems, it can do ok. However, anytime it needs to do something novel it will be hit and miss, usually miss. If it needs to do something where best practice has changed but training data overwhelmingly does bad / dated practice, you'll get that if you don't specify. Loads of issues like that. So, without giving small isolated and well framed tasks the output of which is then critically engaged with, you'll get increasingly opaque and unstable code.