It's coding abilities are hit and miss right now. There are times when it suggests code that just doesn't work, or it makes up a library or a function that does

It's coding abilities are hit and miss right now. There are times when it suggests code that just doesn't work, or it makes up a library or a function that doesn't exist. When I point out the non-existent library or function it actually agrees with me, and will then continue to fail, likely because the required knowledge just isn't in there. But these are still early days and LLM-based products will surely get much better.