4 ms·

> normally I’d push all rate limiting to Redis. Here, we rate limit in memory and assume roughly uniform distribution between server nodes. Dumb question: what

> normally I’d push all rate limiting to Redis. Here, we rate limit in memory and assume roughly uniform distribution between server nodes. Dumb question: what do they mean by rate limiting in memory vs via Redis? Does that mean keeping track of request origins+counts using those storage mechanisms, or something else?

VWWHFSfQ 5y ago
I'm guessing process-local memory. Like a Python dict or something
winrid 5y ago
You can use an in memory LRU cache of request orgin+count. You can also periodically take that data and do an INCREMENT against your DB to get fairly scalable rate limiting.