4 ms·
Given deterministic everything sure, but nothing really is. Perhaps GPU 7 has a very toasty neighbor and is slower.
by buildbot 3y ago
Given deterministic everything sure, but nothing really is. Perhaps GPU 7 has a very toasty neighbor and is slower.
- circuit10 3y agoWhat I’m saying is it’s not correlated to the complexity of the input, because GPT models don’t have a built in way to say “let me stop and think about this”, it’s a fixed amount of computation per token