Generally you not only count potential calories, but also measure you weight. You can then adjust calories up or down to keep hitting your targets as your body

Generally you not only count potential calories, but also measure you weight. You can then adjust calories up or down to keep hitting your targets as your body and your activity levels change.