3 ms·
I think the clearest evidence is Microsofts paper where they show abilities at various stages during training[1]... But in a talk [2], they give more details.
by londons_explore 3y ago
I think the clearest evidence is Microsofts paper where they show abilities at various stages during training[1]... But in a talk [2], they give more details... The unicorn gets worse during the finetuning process.
[2]: https://www.youtube.com/watch?v=qbIk7-JPB2c&t=1392s https://www.youtube.com/watch?v=qbIk7-JPB2c&t=1392s
[1]: https://arxiv.org/abs/2303.12712 https://arxiv.org/abs/2303.12712
- it_citizen 3y agoThanks, that’s interesting. Noobie follow up question: Should we put any trust into “Sparks of intelligence” I thought it was regarded as a Microsoft marketing piece, not a serious paper.
- londons_explore 3y agoThe data presented is true... The text might be rather exaggerated/unscientific/marketing... Also notable that the team behind that paper wasn't involved in designing/building the model, but they did get access to prerelease versions.
- ChatGTP 3y agoI don’t trust it because enough third parties were able to verify the findings. This is the double edge sword of being so ridiculously closed.