3 ms·

Excuse my possible ignorance but I had a question: Does ChatGPT have 'up to date knowledge' in terms of latest versions of software? When I have used it I aske

Excuse my possible ignorance but I had a question: Does ChatGPT have 'up to date knowledge' in terms of latest versions of software? When I have used it I asked it to help me with VueJS but whilst it knew about version 3 (which is substantially different to V2) it didn't know the very latest version. Isn't this going to be problematic if it's trying to help code but has outdated information? Won't this result in more code being written/tied to older languages/framework versions? In my experience, because GPT outputs code tied to particular versions of software, I use those as it's far quicker to copy/paste/edit than reading the latest docs, where GPT is absolutely useless as it simply doesn't know about the latest code and isn't able to produce working snippets. So the real deal would be if GPT knows about the latest software instantly the moment it's published (ingesting docs data, any stackoverflow Q/A's etc). Here is what GPT 4o-mini told me P: can you list me the latest verisons of ALL major languages such as python, node etc. and the latest versions of typescript, angular, vuejs etc R: > Python: 3.12.0 (released in October 2023) > Node.js: 20.5.0 (released in September 2023) > Java: 21 (released in September 2023) > C#: 12 (part of .NET 8, released in November 2023) > Go: 1.21.0 (released in August 2023) > Ruby: 3.2.2 (released in August 2023) > PHP: 8.3.0 (released in August 2023) > Rust: 1.72.0 (released in September 2023) > TypeScript: 5.3.0 (released in September 2023) > Angular: 16.2.0 (released in September 2023) > React: 18.2.0 (released in June 2023) > Vue.js: 3.3.0 (released in September 2023)

8338550bff96 2y ago
You can count on ChatGPT to know the exact versions and release dates of software just the same as you can rely on your friendly neighborhood dev to know it off the top of their head - not at all. A dev would likely have to look it up too. A language model would also need to look it up through function calling (or just including in your prompt). This kind of scenario, where there are concrete answers in some datastore somewhere and the relevance of the content that the model was trained on varies chronologically (a blog post on the latest version of React circa 2015 could deliver a wrong answer), are the ones you want to engineer around. This is where you start using SDKs and binding tools to your LLM so you can ensure grounding context is available to generate correct answers.
rohansood15 2y ago
It's funny you mention that - we just did a Show HN for exactly this yesterday: https://docs.codes https://docs.codes.
esafak 2y ago
This happens with other LLMs too. They don't know what they don't know. They ought to check what version you are using and at least issue a warning if the major number is different.

8338550bff96 2y ago

You can count on ChatGPT to know the exact versions and release dates of software just the same as you can rely on your friendly neighborhood dev to know it off the top of their head - not at all. A dev would likely have to look it up too. A language model would also need to look it up through function calling (or just including in your prompt). This kind of scenario, where there are concrete answers in some datastore somewhere and the relevance of the content that the model was trained on varies chronologically (a blog post on the latest version of React circa 2015 could deliver a wrong answer), are the ones you want to engineer around. This is where you start using SDKs and binding tools to your LLM so you can ensure grounding context is available to generate correct answers.

rohansood15 2y ago

It's funny you mention that - we just did a Show HN for exactly this yesterday: https://docs.codes https://docs.codes.

esafak 2y ago

This happens with other LLMs too. They don't know what they don't know. They ought to check what version you are using and at least issue a warning if the major number is different.