And another part was due to the fact that the CPU couldn't access video memory during scanout -- it went into a wait state -- so your program only actually ran

And another part was due to the fact that the CPU couldn't access video memory during scanout -- it went into a wait state -- so your program only actually ran during hblank and vblank!