3 ms·
> There's no takesies backies with autoregressive models Doesn’t ChatGPT use beam search?
by clbrmbr 3y ago
> There's no takesies backies with autoregressive models
Doesn’t ChatGPT use beam search?
- declaredapple 3y agoAlmost certainly not. It's absolutely just sampling with temperature or top_p/k, etc. Beam searches would be very expensive, I can't see them doing that for chatgpt which appears to be their "consumer product" and often has lower quality results compared to the api. The old legacy had a "best_of" option but that doesn't exist in the new api.