5 ms·
>That's because models have training cut-off dates When I pointed out that it used a deprecated package, it agreed and even cited the correct version after whi
by kgeist 1y ago
>That's because models have training cut-off dates
When I pointed out that it used a deprecated package, it agreed and even cited the correct version after which it was deprecated (way back in 2021). So it knows it's deprecated, but the next-token prediction (without reasoning or tools) still can't connect the dots when much of the training data (before 2021) uses that package as if it's still acceptable.
>I've switched to o4-mini-high via ChatGPT as my default model for a lot of code because it can use its search function to lookup the latest documentation.
Thanks for the tip!
- fragmede 1y agoThere's still skill involved with using the LLM in coding. In this case, o4-mini-high might do the trick, but the easier answer that worry's with other models is to include the high level library documentation yourself as context and it'll use that API.
- th0ma5 1y agoWhate besides anecdote makes you think a different model will be anything but marginally incrementally better?
- jmcpheron 1y ago>I've switched to o4-mini-high via ChatGPT as my default model for a lot of code because it can use its search function to lookup the latest documentation. That is such a useful distinction. I like to think I'm keeping up with this stuff, but the '4o' versus 'o4' still throws me.
- tptacek 1y agoModel naming is absolutely maddening.