Having a 2nd level cache that only has a 2% cache hit rate doesn't really seem worth it... Isn't it better to just get rid of that layer all together and have

Having a 2nd level cache that only has a 2% cache hit rate doesn't really seem worth it... Isn't it better to just get rid of that layer all together and have a simpler system?