3 ms·
The 30x number is for a really narrow scenario tbh. Running a GPT 1.8T parameters (w/ MOE) on one GB200
by my123 3y ago
The 30x number is for a really narrow scenario tbh. Running a GPT 1.8T parameters (w/ MOE) on one GB200
- deleted 3y ago[deleted]
- huac 3y ago'narrow scenario,' perhaps, but one that also happens to closely match rumors for GPT4's size