I’m not aware that internal embedding dimension size has been made public for Gpt4 et al. In general for models we know its trended upward, but for sure it’d b

I’m not aware that internal embedding dimension size has been made public for Gpt4 et al. In general for models we know its trended upward, but for sure it’d be interesting to know what they’re using now.