Yes, but a world-stopping mark and sweep collector is pretty much a non-starter for anything non-trivial in the modern world with full heaps well into the gigab

Yes, but a world-stopping mark and sweep collector is pretty much a non-starter for anything non-trivial in the modern world with full heaps well into the gigabytes. You'd be talking about multiple seconds of delay.