4 ms·
Because if the client specifically requests GPT-3.5, but is silently being served something else instead, the client will rely on having GPT-3.5 capabilities wi
by p-e-w 3y ago
Because if the client specifically requests GPT-3.5, but is silently being served something else instead, the client will rely on having GPT-3.5 capabilities without them actually being available, which is a recipe for breakage.
- brigadier132 3y agoYou do understand that the client will be written by the same people setting up the inference server?