3 ms·

I think we're going to see a pretty large industry shift away from take-home tests given how easily 90% of these tests can be gamed using chat GPT.

• ravenstine 3y ago
  I'd think we'd have already seen this with GitHub Copilot. There was an interview I was part of late last year where the candidate had Copilot turned on during the live coding, and he didn't turn it off even after it was obvious that's what he was using. What I was more surprised by is how I thought this was a bigger deal than everyone else. Like, why come up with these elaborate tests when the candidate is just going to use autocomplete the whole time? Maybe programming in another few years will just be glorified autocomplete and little more. And perhaps testing people on how to write code was a mistake to begin with. It's one thing to write code, but reading code is another.
  • 8note 3y ago
    If they are effective at using it to solve problems, why not? The real challenge is to your testing mechanism and not the candidate
  • d0mine 3y ago
    > Maybe programming in another few years will just be glorified autocomplete and little more. It won't. For the same reason code generation from UML diagrams hasn't replaced programmers [1]. Or why business owner/analysts don't write acceptance tests in Gherkin (Given-When-Then). Though some tasks that programmers had to do manually in the past may be automated (not the first time). [1]: https://news.ycombinator.com/item?id=26934795 https://news.ycombinator.com/item?id=26934795