2 ms·
One question I'm interested in exploring: If models become heavily compressed and streamed from SSD, where do people think the real bottleneck moves to — stora
by fatihturker 7mo ago
One question I'm interested in exploring:
If models become heavily compressed and streamed from SSD, where do people think the real bottleneck moves to — storage bandwidth, memory bandwidth, or kernel efficiency?