2 ms·
The original GPT4 may have been around that size (16x 110B). But it's pretty clear GPT4 Turbo is a smaller and heavily quantized model.
by qeternity 3y ago
The original GPT4 may have been around that size (16x 110B).
But it's pretty clear GPT4 Turbo is a smaller and heavily quantized model.
- IceHegel 3y agoYeah, it’s not even close to doing inference on 1.8T weights for turbo queries.