3 ms·
For code generation, just as exciting as the context length is the new cut off date (2023-04? wow!). It knows about new APIs, frameworks, techniques etc.
by jeswin 3y ago
For code generation, just as exciting as the context length is the new cut off date (2023-04? wow!). It knows about new APIs, frameworks, techniques etc.
- portmanteur 3y agoA cutoff date of April 2023 means the AI also presumably has access to about a month's worth of blogs that have been written since GPT4 was released on March 14th. So perhaps a few "Best Practices" or "Prompt Engineering" guides might have made it into the training set. Chat GPT can probably help users better optimize their conversations with it.
- mannycalavera42 3y agoand all the ai-generated code that refers non-existing libraries :-)
- throwaway4aday 3y agoI know it's just a snarky joke but I would think they are going to screen for bad data, that would be top of my mind if I were training these models. They are probably using GPT-4 internally to assess the new data, they could even have it use search to help vet the information, lots of other strategies even having it write and execute code to test if those libraries work.