So, why did Taylor and Joe call it quits? Was it because of long distance, busy schedules, or creative differences? Nope, to some she left him, to others is the other way around, he left her. Let's remember that one of the reasons she fell for him is that he wasn't impressed by her fame, and Taylor herself has said in her songs how hard it is for her to be wiser, more mature. Really just go and listen to anti hero and you'll hear her say how she would have nightmares about Joe leaving her. Maybe that's what happened.