> Wouldn't moving a bunch of values to/from memory basically empty out all the caches and make this thing really slow anyway? It's probably the same issues as

> Wouldn't moving a bunch of values to/from memory basically empty out all the caches and make this thing really slow anyway? It's probably the same issues as with neural networks: they have to work on a whole batch of inputs to be efficient. They load only a few weights at a time into registers, then use those on the whole batch before loading the next weights. So my guess would be: If you only run a single grid, and the grid is large, you may end up memory-bound and you can afford running inefficient instructions. (Btw. sounds like bitgrid would map 1:1 into the LUTs of an FPGA. Might be a fun project to generate VHDL for it and then let it actually run in parallel. The less straight-forward part being the logic to get the data out of the FPGA again.)