There would still be a curved orbit around the center of the galaxy. That is a bit like arguing that a mission from Earth to Mars would travel in a straight lin

There would still be a curved orbit around the center of the galaxy. That is a bit like arguing that a mission from Earth to Mars would travel in a straight line because there isn't anything in between them.