Computer architecture researchers have been working at this for a long time. Here's a recent paper on a technique to do the division and modulus operations for

Computer architecture researchers have been working at this for a long time. Here's a recent paper on a technique to do the division and modulus operations for arbitrary numbers of cache banks and set sizes. http://www.cs.utexas.edu/~skeckler/pubs/MICRO_2014_Modulus_Indexing.pdf http://www.cs.utexas.edu/~skeckler/pubs/MICRO_2014_Modulus_I... They evaluate the technique on a GPU because bank and set conflicts can lead to bad performance more easily on a GPU than a CPU.