3 ms·
That's odd because when I gave ChatGPT my icebreaker interview question that I used a lot at Google it fell right on its face. And this is a question I expect t
by jeffbee 4y ago
That's odd because when I gave ChatGPT my icebreaker interview question that I used a lot at Google it fell right on its face. And this is a question I expect teenagers to ace in one minute.
- riku_iki 4y agoMaybe it passed 1 out of 1000 interviews
- ben_w 4y agoDoesn't seem odd to me, in fact this is what I would've predicted in advance. Intelligence in general, not just of the artificial kind, often comes with blind spots of one kind or another. ChatGPT isn't even trying to replicate the structure of a human brain, so that it's failure modes are different to ours should not be surprising. That it can even do this well given it has a network with a similar number of parameters as a (naïve estimate of a) rat's brain, is what's remarkable.
- nothrowaways 4y agoWrite it down here with the answers, and it will excel at it in next iteration.
- emuneee 4y agoI saw this article and fed ChatGPT a bunch of questions I've seen before in my coding interviews. It nailed most of the algorithms, however, it failed completely giving me test cases it would run to test the function it just regurgitated. ie...it gave me an input then mostly incorrect/invalid expected outputs.
- silveroriole 4y agoAgreed, something is odd about this. A few people have sent me code that ChatGPT has written for them. They don’t have the capability to determine if the code is good so they ask me. If the result is even something that will compile or address the asked problem at all, it’s barely competent nonsense that only a beginner programmer would write. For example asking it for code that will generate recipes, and you get back code for a random selection from an array with “Italian, Chinese, pizza”. It never asks clarifying questions either, it’s perfectly happy with a “garbage in garbage out” approach. So if ChatGPT is passing the interview, the interview questions are not selecting for what I would consider a good developer.
- jeffbee 4y agoExactly. The point of the interview is for two people to have an exchange of thoughts, not for the candidate to literally program the whiteboard. All of my interview feedback on candidates centered around how they asked clarifying questions given incomplete or ambiguous prompts, and how they explained the limitations and assumptions of their approach. Whether or not they reached a conclusion was footnoted.
- lostmsu 4y agoWithout hearing the question it is hard to make judgement.