3 ms·
What are some good text books or resources on streaming and queues?
I have never used Kafka or had to maintain queues with more than a hundred jobs per hour. Most of the jobs queues I've had to maintain are doing simple things like sending emails or updating a third party API.
I've always resorted to simpler distributed redis based job queues such as kue [0], bull [1], celery [2] or resque [3].
I would like to learn more about distributed queues and architectures from first principles. Where is a good place to go?
[0] https://github.com/Automattic/kue
[1] https://github.com/OptimalBits/bull
[2] http://www.celeryproject.org/
[3] https://github.com/resque/resque
- yamrzou 7y agoA good start is this article by Jay Kreps (Apache Kafka co-creator and Confluent co-founder) : The Log: What every software engineer should know about real-time data's unifying abstraction : https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying https://engineering.linkedin.com/distributed-systems/log-wha...
- slap_shot 7y agohttps://book.huihoo.com/pdf/confluent-kafka-definitive-guide-complete.pdf https://book.huihoo.com/pdf/confluent-kafka-definitive-guide... https://dataintensive.net/ https://dataintensive.net/
- akshayshah 7y agoHuge +1 to Martin Kleppmann's "Designing Data-Intensive Applications." It's the best single-volume introduction I've seen to the fundamentals of databases, queues, and the complications inherent in making those systems distributed.