I think that it would follow you. Past you would have no advance memory of meeting future you until future you went back in time and met past you, at which poi

I think that it would follow you. Past you would have no advance memory of meeting future you until future you went back in time and met past you, at which point you would have memories from both points being produced at the same time.