4 ms·
Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly. Does this client
by hoistbypetard 4y ago
Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly.
Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?
- houqp 4y agoWe cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
- darig 4y ago
- rockwotj 4y agoHow does cache invalidation work?
- houqp 4y agoIt's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh. I have plan to add automated streaming data update in the background, starting with delta lake tables. It should all be very straight forward to implement.