The time traveller exists in this timeline. While it might not be the optimal timeline, it is possibly one of a small subset where the time traveller exists. The time traveller existing is probably a basic requirement for it being among the preferred timelines. But, as Back to the Future showed, you can always time travel, disrupt the past only slightly, and return to a timeline that was better than the one you left.