Depends on the architecture, but generally you just move through the layers linearly. Simple iteration. The number of layers, and the amount of time spent in e

Depends on the architecture, but generally you just move through the layers linearly. Simple iteration. The number of layers, and the amount of time spent in each of them, makes me think any benefit from pre-loading the layer ahead is negligible. You really need the entire model on device to consider it performant.