14 ms·
In a "have you memorized the code to solve this problem" interview? Probably. In a "can you solve this new leetcode problem that just came out and is not in th
by pedrosorio 3y ago
In a "have you memorized the code to solve this problem" interview? Probably.
In a "can you solve this new leetcode problem that just came out and is not in the training data"? Awful.
- postalrat 3y agoThere are probably about 30 or so leetcode problems and then endless variations made for those 30 problems. The best people on leetcode practice and memorize. If you want to see an example of a new problem check out https://news.ycombinator.com/item?id=37910297 https://news.ycombinator.com/item?id=37910297. You'd think if leetcode makes you good at solving problems then it should be doable any higher ranking leetcode programmer.
- pedrosorio 3y ago> There are probably about 30 or so leetcode problems and then endless variations made for those 30 problems. The best people on leetcode practice and memorize. The comment I replied to claimed that "LLMs would do pretty well at leetcode interviews". OpenAIs own report [0] shows how GPT-4 fails miserably at medium/hard leetcode problems that are not in the training data. [0] https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf
- postalrat 3y agoI wouldn't consider doing 31/41 easy problems, 21/80 of medium problems, and 3/45 of hard problems a failure. GPT-4 wasn't built to solve these problems but can still do 3 of 45 hard problems. Hell I don't know if you sat down 45 random programmers if 3 of them could solve those 3 problems GPT-4 was able to do, and nobody could solve them in the time it took GPT-4.