Kant had the same "confusion" which is why he considered space and time "forms of intuition", a slightly misleading translation from the German word Anschauungs

Kant had the same "confusion" which is why he considered space and time "forms of intuition", a slightly misleading translation from the German word Anschauungsformen. These Anschauungsformen in his view a part of the conditions for mathematical thinking and together with the categories make it possible. I'm not writing that under the assumption that Kant was right, his philosophy is based on something like "inner intuitions" that are dubious and in my opinion do not match modern mathematics very well which deals with objects that go far beyond our visual imaginative capabilities and what we might check with some kind of "inner intuition" (innere Anschauung) or geometrical insights. I just wanted to point out you're not alone and if you're confused, then in an elaborate way.