3 ms·

Have you tried asking it your company's tech interview coding challenge questions yet? I have, and I'm pretty convinced coding challenges are going to be a thi

by koboll 4y ago

Have you tried asking it your company's tech interview coding challenge questions yet? I have, and I'm pretty convinced coding challenges are going to be a thing of the past soon. Either that or there will need to be extreme anti-cheating measures in place.

agolio 4y ago
It's better than 90% of our applicants for junior positions. I doubt we would hire it, but it would definitely pass the first tech screens.
- koboll 4y ago
  I guess by thing of the past soon I don't mean ChatGPT will literally end coding challenges immediately, but whatever comes next (analogous to DALL-E 2 -> Stable Diffusion -> Midjourney 4 -> ???) probably will. For junior positions first, then mid-level...
hoosieree 4y ago
I teach CS/Engineering at a university and it's really making me rethink how we should be teaching and what we should be emphasizing. This has a strong feel of "why should I learn multiplication tables when I have a calculator with me at all times?" But instead of multiplication tables it's the entire curriculum. I can see this becoming a standard tool, which shifts the burden on the student from writing code to critically reading code, writing tests, and learning how to judge correctness.
- nerdponx 4y ago
  > This has a strong feel of "why should I learn multiplication tables when I have a calculator with me at all times?" But instead of multiplication tables it's the entire curriculum. But the counter-argument is the same: you don't want to be reliant on a calculator at all times. And that's assuming the tech can even get to the point of replacing the curriculum. It only works as well as it does because it's been trained on text that is effectively many past curricula. What if you add something new? The model will be useless. I'd be shocked if ChatGPT knew as much about, say, Coq as it did about Python.
- VectorLock 4y ago
  ChatGPT is just regurgitating what they've fed it. Admittedly it does a really nice job of regurgitating and formatting that regurgitation really well but at the end of the day its just a really nice Google/StackOverflow in the CS world. It doesn't understand concepts, which students will need to understand how to extend our body of knowledge rather than just copy/paste it.
nerdponx 4y ago
I've already been doing tech interviews on live phone calls, either on some collaborative coding platform or just sharing my screen. Take-home challenges will become a thing of the past, but they're extremely easy to cheat on anyway (pay someone to write it for you) and also disrespectful of the candidate's time (a 4-hour take-home task is a 4-hour interview), so good riddance.

by koboll 4y ago

agolio 4y ago

It's better than 90% of our applicants for junior positions. I doubt we would hire it, but it would definitely pass the first tech screens.

koboll 4y ago
I guess by thing of the past soon I don't mean ChatGPT will literally end coding challenges immediately, but whatever comes next (analogous to DALL-E 2 -> Stable Diffusion -> Midjourney 4 -> ???) probably will. For junior positions first, then mid-level...

hoosieree 4y ago

I teach CS/Engineering at a university and it's really making me rethink how we should be teaching and what we should be emphasizing. This has a strong feel of "why should I learn multiplication tables when I have a calculator with me at all times?" But instead of multiplication tables it's the entire curriculum. I can see this becoming a standard tool, which shifts the burden on the student from writing code to critically reading code, writing tests, and learning how to judge correctness.

nerdponx 4y ago
> This has a strong feel of "why should I learn multiplication tables when I have a calculator with me at all times?" But instead of multiplication tables it's the entire curriculum. But the counter-argument is the same: you don't want to be reliant on a calculator at all times. And that's assuming the tech can even get to the point of replacing the curriculum. It only works as well as it does because it's been trained on text that is effectively many past curricula. What if you add something new? The model will be useless. I'd be shocked if ChatGPT knew as much about, say, Coq as it did about Python.
VectorLock 4y ago
ChatGPT is just regurgitating what they've fed it. Admittedly it does a really nice job of regurgitating and formatting that regurgitation really well but at the end of the day its just a really nice Google/StackOverflow in the CS world. It doesn't understand concepts, which students will need to understand how to extend our body of knowledge rather than just copy/paste it.

nerdponx 4y ago

I've already been doing tech interviews on live phone calls, either on some collaborative coding platform or just sharing my screen. Take-home challenges will become a thing of the past, but they're extremely easy to cheat on anyway (pay someone to write it for you) and also disrespectful of the candidate's time (a 4-hour take-home task is a 4-hour interview), so good riddance.