3 ms·

nice, inference is still primarily a compute workload.

• bobvanluijt 3y ago
  Yes, personally, I'm actually very bullish on CPU inference for both models and the vector DB.