4 ms·
I’ve been experimenting with both ChatGPT and Copilot. I find that Copilot is much more accurate and context-aware, but I can’t use it everywhere—e.g. when work
by simonmesmith 4y ago
I’ve been experimenting with both ChatGPT and Copilot. I find that Copilot is much more accurate and context-aware, but I can’t use it everywhere—e.g. when working in a shared Colab notebook. Conversely, I find that ChatGPT is better if I’m brainstorming some ideas and want to get a high-level sense of different ways to execute them in code.
This said, ChatGPT has a tendency to get things about 95% right, so you have to be very careful. For example, I was playing with it yesterday and it wrote a Python function with regex that didn’t do what I had asked, even though it said it did. I pointed out the error and it rewrote the regex but made it worse.
Oddly, when I started another thread and asked ChatGPT just for the regex outside of a Python function, it nailed it. So I do think prompt engineering can overcome some of the limitations I’ve seen to date.