3 ms·
256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps
by hoppp 1y ago
256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps