The higher levels of the stack, be it hardware or software, need to make sure that never happens. That’s how GPUs are doing that. Each thread group can use a l

The higher levels of the stack, be it hardware or software, need to make sure that never happens. That’s how GPUs are doing that. Each thread group can use a limited amount of SRAM, programs declare in advance how many bytes they need. Then in runtime the scheduler who dispatches tasks to cores enforces that limit by never dispatching too many thread groups on each core.