2 ms·
IMO the worst problem with leetcode challenges are the fact they are 100% in the training set of LLMs. They solve them instantly, and making matters worse they
by bearjaws 2y ago
IMO the worst problem with leetcode challenges are the fact they are 100% in the training set of LLMs.
They solve them instantly, and making matters worse they are 100% valueless to a company.
What universe do we live in that hiring managers want staff that are 100% as skilled as an LLM but probably not as strong in areas that actually matter?
The reality everyone with a brain is going to cheat on these, they are typically pretty early in the interview process and it will hopefully get replaced with a real world test.
At my last job we just used example problems that we had seen in the past, usually REST API focused with just enough nuance to make engineers think through it and potentially refactor their code. Then you can ask them specifics of their thought process and get insight to their experience.