2 ms·
> On a given high-throughput Kafka topic, this figure goes up to 11 MB/s per vCPU. There's got to be 2x to 10x improvement to be made there, no? No way CPU is
by sebstefan 2y ago
> On a given high-throughput Kafka topic, this figure goes up to 11 MB/s per vCPU.
There's got to be 2x to 10x improvement to be made there, no? No way CPU is the limitation these days and even bad hard drives will support 50+mB/s write speeds.
- ddorian43 2y agoBuilding inverted index is very CPU intensive.
- fulmicoton 2y agoBuilding an inverted index is actually very cpu intensive. I think we are the fastest on that (if someone knows something faster than tantivy at indexing I am interested). I'd be really surprised if you can make a 10x improvement here.