4 ms·
When discussing “n parameters,” such as 6B parameters or in the case of GPT4 around 1.7T is the rumored parameters size, each parameter is a dimension. So, yeah
by fnordpiglet 3y ago
When discussing “n parameters,” such as 6B parameters or in the case of GPT4 around 1.7T is the rumored parameters size, each parameter is a dimension. So, yeah, that’s a lot more than 2d or even 2000d. More like 1,700,000,000,000D.