4 ms·
I got the impression that the most valuable models were not published. Would Microsoft have access to those too according to their contract?
by bertil 3y ago
I got the impression that the most valuable models were not published. Would Microsoft have access to those too according to their contract?
- ncann 3y agoDon't they need access to the models to use them for Bing?
- armcat 3y agoNot necessarily, it would be just RAG, the use the standard Bing search engine to retrieve top K candidates, and pass those to OpenAI API in a prompt.
- bertil 3y agoI would consider those models "published." The models I had in mind are the first attempts at training GPT5, possibly the model trained without mention of consciousness and the rest of the safety work. There is also all the questions for RLHF, and the pipelines to think around that.