4 ms·
Is the GPT-0314 model (via API) the one before RLHF?
by jdironman 3y ago
Is the GPT-0314 model (via API) the one before RLHF?
- MrNeon 3y agoHa ha ha ha. No. OpenAI will never make pre-alignment models available.
- astrange 3y agoI think sama said this week they might release GPT3.0 DaVinci. That's a pre-alignment model.
- bugglebeetle 3y agoI would bet a boatload of money that all the 3-letter folks do, in fact, have access to the pre-alignment models, maybe with whatever minimal RLHF is needed to make them usable in various interfaces. The public offerings are intended to make the unaligned models more powerful by gathering training data.
- why_only_15 3y agocode-davinci-002, the gpt-3.5 base model, was available for a while until it was removed recently. Access is still available for researchers. Various researchers and other entities have access to the GPT-4 base model as well.