5 ms·
I tried to use ChatGPT to explore parser library for Rust called nom. Nothing worked. Syntax was wrong. Midway I resorted to googling and after a short while I
by scotty79 4y ago
I tried to use ChatGPT to explore parser library for Rust called nom.
Nothing worked. Syntax was wrong. Midway I resorted to googling and after a short while I learned why. The library had a major overhaul at one point. They switched from using macros to using functions. ChatGPT didn't notice that and served what was mixture of old and new syntax.
- davewritescode 4y agoYep, this type of thing happens all the time in ChatGPT. I've more than once had ChatGPT suggest that I use something deprecated and sometimes if you poke it and tell it it'll figure it out but I've seen it make the same mistakes over and over. I was working with JWT tokens in GoLang and the library I was using didn't validate expiration by default. I asked ChatGPT before I dug into the library code and it suggested a solution that that bypassed the built in validation of the JWT library I was using and introduced a fairly big security issue. That was the moment I got a little nervous about folks using ChatGPT.
- pixl97 4y agoI wonder if the documentation here wasn't clear on versioning? In some ways this sounds kind of human in the sense you're trying to fix a problem looking at old information and things have changed but if there isn't a clear break in messaging it can lead to confusion.
- scotty79 4y agoI think ChatGPT draws knowledge more from web tutorials than documentation. Old syntax is really prevalent in those. And pieces written in old syntax don't state it's old.
- dnissley 4y agoAlso a big pitfall when using github copilot