3 ms·
> With that said, I don't think LLMs will be helpful with some of the tougher problems. It's a hard thing to test, because I assume CoPilot would do well with p
by yunwal 3y ago
> With that said, I don't think LLMs will be helpful with some of the tougher problems. It's a hard thing to test, because I assume CoPilot would do well with previous year challenges due to the massive amount of public code available on the same problems.
I'm not 100% sure on this, but I think copilot isn't trained on anything past January 2022 (the gpt-3.5 and 4 cutoff dates), so I think it still shouldn't do well with AoC questions from 2022
- avarun 3y agoYou mean September 2021, right?
- yunwal 3y agoI'm basing that off this community post and a few other forums that noted that GPT knows about events after September 2021. Point stands either way. https://community.openai.com/t/what-is-the-actual-cutoff-date-for-gpt-4/394750 https://community.openai.com/t/what-is-the-actual-cutoff-dat...
- danielbln 3y agoIt seems the cut-off has shifted from September 21 to January 22 recently.