3 ms·
The GPT4 model is crazy huge. Almost 1T parameters, probably 512 to 1TB of vram minimum. You need a huge machine to even run it inference wise. I wouldn't be
by novok 3y ago
The GPT4 model is crazy huge. Almost 1T parameters, probably 512 to 1TB of vram minimum. You need a huge machine to even run it inference wise. I wouldn't be surprised they are just having scaling issues vs any sort of conspiracy issue.
- dragonwriter 3y ago> Almost 1T parameters AFAIK, there is literally no basis but outside speculation for this persistent claim.