4 ms·
I would really enjoy using it. But as a novice data intensive application developer, why would I not query the table 30 seconds and look for changes with a Pyth
by unixhero 2y ago
I would really enjoy using it. But as a novice data intensive application developer, why would I not query the table 30 seconds and look for changes with a Python program (or another regular programming language)?
- bobnamob 2y agoOne of the best resources to understand "why would I not ... ?" in a data intensive context is Kleppmann's Designing Data-Intensive Applications[1] (mentioned elsewhere in the comments). There's a lot of nuance to why event streaming wins out over periodically "polling" a database, mostly about maintaining correctness while being able to scale horizontally. Taking a look at the Kafka docs [2] is also enlightening. [1] https://www.amazon.com/Designing-Data-Intensive-Applications-Reliable-Maintainable/dp/1449373321 https://www.amazon.com/Designing-Data-Intensive-Applications... [2] https://kafka.apache.org/documentation/#gettingStarted https://kafka.apache.org/documentation/#gettingStarted
- agentofreality 2y agoHere is a new Drasi blog post that might help you understand why Drasi is preferable to writing code that periodically polls a database: https://opensource.microsoft.com/blog/2024/10/22/detect-and-react-intelligently-to-changes-in-data-with-drasi/ https://opensource.microsoft.com/blog/2024/10/22/detect-and-...