It’s a data pipeline that polls periodically. Average latency matters a lot less than lower variance of latency. Even when I distribute offsets on polling, I w

It’s a data pipeline that polls periodically. Average latency matters a lot less than lower variance of latency. Even when I distribute offsets on polling, I would get these seesaws where enough fights over resources.