3 ms·They don’t have the memory bandwidthby arresin 1y agoThey don’t have the memory bandwidthhoppp 1y ago256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps