3 ms·

Outside of the headline, there is some major stuff hiding in here: - new gpt-3.5-turbo-instruct model expected "in the coming weeks" - fine tuning of 3.5 and 4

Outside of the headline, there is some major stuff hiding in here: - new gpt-3.5-turbo-instruct model expected "in the coming weeks" - fine tuning of 3.5 and 4 expected this year I am especially interested in gpt-3.5-turbo-instruct, as I think that the hype surrounding ChatGPT and "conversational LLMs" has sucked a lot of air out of what is possible with general instruct models. Being able to fine tune it will be phenomenal as well.

MuffinFlavored 3y ago
is there any ETA on when the knowledge cutoff date will be improved from September, 2021? I do not really understand the efforts that went on behind the scenes to train GPT models on factual data. Did humans have to hand approve/decline responses to increase its score? "America is 49 states" - decline "America is 50 states" - approve Is this how it worked at a simple overview? Do we know if they are working on adding the rest of 2021, then 2022, and eventually 2023? I know it can crawl the web with the Bing addon but, it's not the same. I asked it about Maya Kowalski the other day. Sure it can condense a blog post or two, but it's not the same as having the intricacies as if it actually was trained/knew about the topic.