Any cache effects from using less memory would be represented in encoding speed, which is what matters. If your video encoder pages into swap, you've lost all

Any cache effects from using less memory would be represented in encoding speed, which is what matters. If your video encoder pages into swap, you've lost all hope of being fast. Software HEVC encoding on mobile devices is not a use case most people care about.