4 ms·

Cheat where possible using OpenGPT. Cheat where possible using OpenGPT. Cheat where possible using OpenGPT. We must prove to companies that leetcode is not t

Cheat where possible using OpenGPT. Cheat where possible using OpenGPT. Cheat where possible using OpenGPT. We must prove to companies that leetcode is not the way.

jrockway 4y ago
I asked ChatGPT one of my company's interview questions (which involves designing a bloom filter). It got it very subtly wrong; when asked to fix things, it made it worse. I would definitely not use it to interview for jobs yet, but I do think it would be good for training interviewers to detect BS and suggest "hints" that lead things in the right direction. Practice interview without wasting any human's time! Meanwhile, humans have not really struggled with this problem. We tell you what a bloom filter is, you just have to write the code to spec. (This is different than some interviews where you need to know the answer to the trivia question; know what a bloom filter is and how to implement one, or you fail. ChatGPT was not capable of either.) Overall my take on the current state of AI-produced computer programs is that the programmer is forced to take on the role of code reviewer and detail checker, which I think is a more difficult problem than just typing in code in a green-field environment. The thing that's difficult about reviewing code is that things can diverge away from your mental model so quickly, that you don't know which details you should be checking up on. When you're writing it from scratch, you don't lead yourself astray in the same way. In a few years this could be completely different, of course.
- gymbeaux 4y ago
  It's been working well for me all things considered. The harder the leetcode problem, the more I have to ask it to fit the answer it gives me, but I have always gotten it to arrive at the correct (and most efficient) answer. I'm impressed. You'll have a better time with it if you can tell it what's wrong with the code, even if it's just "given this test case, I expected X but this code gives me Y".
paxys 4y ago
You don't need OpenGPT (or whatever else) to "cheat" at interviews. Simply copy pasting the prompt in Google is going to get you much better results, most often the exact leetcode page that the question was lifted from (with very useful discussion and solutions). Of course most competent companies will ask a minor follow-up which will stump candidates who are relying on such tools.
- gymbeaux 4y ago
  "most competent companies" wouldn't rely so heavily on leetcode in the first place.
Der_Einzige 4y ago
If you're good enough at prompting ChatGPT to get a working leetcode hard solution in the time allowed, you're good enough at writing complete and correct code for the job.
- gymbeaux 4y ago
  Amen brother
singpolyma3 4y ago
But leetcode is so fun! I've applied to interview a few places I never plan to work at, just so I could do their leetcode interviews. It's like a brain teaser book but you also get a live human evaluating.
- gymbeaux 4y ago
  I sometimes interview just to stay somewhat sharp. I interview with Amazon every time they ask, which is every 6-12 months, and they actually gave me Leetcode Hard last go around in October. Usually they give me Leetcode Medium. It's always for a SWE II role so that doesn't explain the increase in difficulty. Makes sense they are being more selective ahead of layoffs though. I'm sure someone high up knew the layoffs were coming about a year in advance.
  - vineyardmike 4y ago
    > Makes sense they are being more selective ahead of layoffs though. Nah the interviewer has full discretion at Amazon to pick the questions. You just found someone who thought Hard was the correct bar to set.

Cheat where possible using OpenGPT. Cheat where possible using OpenGPT. Cheat where possible using OpenGPT. We must prove to companies that leetcode is not the way.

jrockway 4y ago

I asked ChatGPT one of my company's interview questions (which involves designing a bloom filter). It got it very subtly wrong; when asked to fix things, it made it worse. I would definitely not use it to interview for jobs yet, but I do think it would be good for training interviewers to detect BS and suggest "hints" that lead things in the right direction. Practice interview without wasting any human's time! Meanwhile, humans have not really struggled with this problem. We tell you what a bloom filter is, you just have to write the code to spec. (This is different than some interviews where you need to know the answer to the trivia question; know what a bloom filter is and how to implement one, or you fail. ChatGPT was not capable of either.) Overall my take on the current state of AI-produced computer programs is that the programmer is forced to take on the role of code reviewer and detail checker, which I think is a more difficult problem than just typing in code in a green-field environment. The thing that's difficult about reviewing code is that things can diverge away from your mental model so quickly, that you don't know which details you should be checking up on. When you're writing it from scratch, you don't lead yourself astray in the same way. In a few years this could be completely different, of course.

gymbeaux 4y ago
It's been working well for me all things considered. The harder the leetcode problem, the more I have to ask it to fit the answer it gives me, but I have always gotten it to arrive at the correct (and most efficient) answer. I'm impressed. You'll have a better time with it if you can tell it what's wrong with the code, even if it's just "given this test case, I expected X but this code gives me Y".

paxys 4y ago

You don't need OpenGPT (or whatever else) to "cheat" at interviews. Simply copy pasting the prompt in Google is going to get you much better results, most often the exact leetcode page that the question was lifted from (with very useful discussion and solutions). Of course most competent companies will ask a minor follow-up which will stump candidates who are relying on such tools.

gymbeaux 4y ago
"most competent companies" wouldn't rely so heavily on leetcode in the first place.

Der_Einzige 4y ago

If you're good enough at prompting ChatGPT to get a working leetcode hard solution in the time allowed, you're good enough at writing complete and correct code for the job.

gymbeaux 4y ago
Amen brother

singpolyma3 4y ago

But leetcode is so fun! I've applied to interview a few places I never plan to work at, just so I could do their leetcode interviews. It's like a brain teaser book but you also get a live human evaluating.

gymbeaux 4y ago
I sometimes interview just to stay somewhat sharp. I interview with Amazon every time they ask, which is every 6-12 months, and they actually gave me Leetcode Hard last go around in October. Usually they give me Leetcode Medium. It's always for a SWE II role so that doesn't explain the increase in difficulty. Makes sense they are being more selective ahead of layoffs though. I'm sure someone high up knew the layoffs were coming about a year in advance.
- vineyardmike 4y ago
  > Makes sense they are being more selective ahead of layoffs though. Nah the interviewer has full discretion at Amazon to pick the questions. You just found someone who thought Hard was the correct bar to set.