I think you pretty much explained the solution. You need buffering plus real time VM suspend+resume. I was thinking the client could keep sending last shown fra

I think you pretty much explained the solution. You need buffering plus real time VM suspend+resume. I was thinking the client could keep sending last shown frame data back to the server and if a hiccup is detected the server stops the clock cycles on the VM and resumes the clock as soon as the buffer is empty. This may lead the user to see a loader for a short time.