Right now its a bit like Tesla's self driving. It mostly works but mostly works isn't a great standard and maintaining supervision to correct errors involves c

Right now its a bit like Tesla's self driving. It mostly works but mostly works isn't a great standard and maintaining supervision to correct errors involves continually re-building state and trying to debug AI-code which can be more taxing than just doing the thing yourself. This is case by case of course.. I used it the other day to generate fairly idiomatic table-driven tests. It took a few swings plus some manual tweaking but as I don't particularly enjoy writing tests I was pretty satisfied with the outcome and it had more coverage than I probably would've written. Well worth the 25 cents in API credits. On the other hand, there have been more than a few times I've given up trying to nudge the AI and just did it myself. In those cases it was just a net negative and just wasted time. So the trick is feeling out where that line is for each model so wasted time < saved time.