4 ms·
Yeah, but the "AI" on CPU means some basic NPU doing (sparse) matrix multiplication, not AVX512.
by treprinum 2y ago
Yeah, but the "AI" on CPU means some basic NPU doing (sparse) matrix multiplication, not AVX512.
- 0xDEADFED5 2y agoI'm handling dense, sparse, and colbert vectors generated by BGE-M3 model on CPU, pretty sure that counts as "AI"