3 ms·
It would make no difference at best for token generation and would actually run slower for prompt processing since it has fewer gflops than the CPU cores.
by ryao 2y ago
It would make no difference at best for token generation and would actually run slower for prompt processing since it has fewer gflops than the CPU cores.