3 ms·
But we don’t know whether davinci still maps to 175B anymore. Realistically speaking, in order to offer ChatGPT Plus, they will have to have more model instanc
by karmasimida 4y ago
But we don’t know whether davinci still maps to 175B anymore.
Realistically speaking, in order to offer ChatGPT Plus, they will have to have more model instance running concurrently. Because the promise is no wait time, but they can’t magically increasing number of hosts over a short period of time. DC took months to ramp up.
So the realistic solution is to shrink model size so one instance can serve two models, 3 models or even 4 models
And label it as Turbo mode