Suppose I just want to use my Nvidia card in GPU mode (i.e. monitor only connected to Intel integrated video), does the X.org version still impact me? Or does

Suppose I just want to use my Nvidia card in GPU mode (i.e. monitor only connected to Intel integrated video), does the X.org version still impact me? Or does the 'nvidia' proprietary driver somehow pull in Xorg dependencies even when not displaying anything?