3 ms·
I tried giving ChatGPT an extremely easy “warmup” interview question, and it passed it with flying colors. But then I added the catch that it has to handle UTF-
by sgerenser 4y ago
I tried giving ChatGPT an extremely easy “warmup” interview question, and it passed it with flying colors. But then I added the catch that it has to handle UTF-8 strings and not just ASCII, and it confidently spewed out the same program, claiming that by using the c library functions isspace and ispunct, unicode is handled because they let you pass a locale. This is, of course completely wrong. I even gave an example of an input it would fail on and it shrugged and returned roughly the same function that would still fail on that input.
- wwweston 4y agoOn the plus side, this sounds a lot like the kind of mistake a human engineer would make.
- sgerenser 4y agoSort of, but I wouldn’t expect a human engineer to be so confidently incorrect. In fact, it would be a big red flag. I’d much rather have a “you know, I’m not very familiar with Unicode or UTF-8, so I’d have to do some research before I could come up with an answer.”
- rpep 4y agoI did similar, I asked it to compute the median on some filtered time series data, but as I added more requirements to the filtering it couldn’t seem to adapt the program.