3 ms·
Bing Chat appears to specifically, be an 'early' (to quote the MS press statement) GPT-4. I read that as implying that it was only partially trained, and so bet
by gwern 4y ago
Bing Chat appears to specifically, be an 'early' (to quote the MS press statement) GPT-4. I read that as implying that it was only partially trained, and so better than GPT-3.5, but still well below the final GPT-4 model.
- cubefox 4y agoI've read that just as Bing using the GPT-4 foundation model, which finished training in August 2022, according to OpenAI. Microsoft doing the tuning themselves would explain why this aspect wasn't on par with ChatGPT. Microsoft previously tuned MT-NLG for their Indian Sydney test, so they would have some experience.