3 ms·
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
by houqp 4y ago
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
- darig 4y ago
- rockwotj 4y agoHow does cache invalidation work?
- houqp 4y agoIt's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh. I have plan to add automated streaming data update in the background, starting with delta lake tables. It should all be very straight forward to implement.