3 ms·
This is why OpenAI and Anthropic provide date versioned models. gpt-4o can change, but gpt-4o-2024-05-13 will always use the 2024-05-13 snapshot.
by SparkyMcUnicorn 2y ago
This is why OpenAI and Anthropic provide date versioned models.
gpt-4o can change, but gpt-4o-2024-05-13 will always use the 2024-05-13 snapshot.
- cj 2y agoi have a feeling those dates are an illusion of sorts. I get the feeling they frequently deploy hot patches for edge cases. I hate to call them edge cases because they are actually “real cases” - things like adjusting system prompts so one day it might happy answer “Fill in the blank: F _ _ _ you”. To truly freeze a model, you would need to freeze its weights, freeze its system prompts (no one sees those), and avoid any and all action that might impact its output. Perhaps would even need the default temperature to be 0 so it’s truly a deterministic API, with the option to add in some temperature to the responses. Until then, I consider those “versions” but only reference the model weights and not the abstractions around the model
- felixvolny 2y agoTangent, but it seems like such a tough engineering challenge to keep all these models around and available at an instant