3 ms·
How is this anything other than a normal database app? How many bikes are being shared that you need a 'data pipeline' and 'stream sets' and Kafka and MapD to m
by CyberDildonics 8y ago
How is this anything other than a normal database app? How many bikes are being shared that you need a 'data pipeline' and 'stream sets' and Kafka and MapD to make it 'real time'
- free652 8y agoWell don't you need to get the data into a database? How would you design a system that collects data from a million bikes? Kafka acts like a buffer, because downstream systems may not be fast enough to transform and persist the data during spikes.
- randyzwitch 8y agoGood point. While this demonstration is for a single bike-sharing program, there are over 200 feeds that conform to the GBFS specification, most updating roughly every 10 seconds.
- randyzwitch 8y agoIt is a simple demonstration of how different tools work together. Feel free to do something else.