2 ms·
Yeah, you recommended a sockets library as an alternative to a distributed durable circular buffer. Not obviously clueful. Might as well recommend Nginx as an a
by kod 10y ago
Yeah, you recommended a sockets library as an alternative to a distributed durable circular buffer. Not obviously clueful. Might as well recommend Nginx as an alternative to JavaScript.
I need to durably handle billions of events per day. No amount of redefining changes the underlying business problem.
Kafka, on the other hand, has been helping me solve that problem for years.
- dkarapetyan 10y agoLet's see. I can handle a few million on a single instance and I have yet to hit any memory or CPU limits indicating I can handle 10x of what I'm currently handling. Oh and it's about 100k or more transactions per hour at peak load. Just from basic operational observation and logs. Also, have yet to see any durability issues and I've managed to do it without kafka. So pretty basic math says the entire thing can be scaled to a "few billion" transactions in a pretty straightforward way. Then again I'm more willing to redefine my problems to come up with simpler solutions. But this discussion has devolved into personal insults at this point. We have nothing to teach each other it seems.
- kod 10y agoIf nothing else, I could teach you that zeromq has nothing to do with queing or durability. It's certainly possible that Rabbit has improved in the years since I used it, if it works for your use cases, great. But don't assume that everyone using a popular technology is doing so because of a fad or without understanding the tradeoffs.