This was a big thing in video game development in the mid 90's/early 2000's. So long as you can keep the code and data or at least manageable chunks of it in ca

This was a big thing in video game development in the mid 90's/early 2000's. So long as you can keep the code and data or at least manageable chunks of it in cache, that would give huge performance gains. Things like the Ps2 VPU1 16KByte cache and the much more limited VPU0 with 4Kbyte cache. There were many titles that just did not use VPU0 for anything high performant simply because the cache limit killed its potential.