I wrote a cache layer in Go (with limits so it doesn't bloat too much) and I could get 22K req/s instead of the usual 4K. However, the hit ratio is too low to

I wrote a cache layer in Go (with limits so it doesn't bloat too much) and I could get 22K req/s instead of the usual 4K. However, the hit ratio is too low to work. It only protects me from the stampeding herd problem at best.