L1 caches are usually N-way associative, so that should only become a consistent problem if you access N distinct addresses with the same key (in this case the

L1 caches are usually N-way associative, so that should only become a consistent problem if you access N distinct addresses with the same key (in this case the same offset (with likely 64-byte granularity) relative to a 4K boundary).