The problem is that you are travelling with your emotions and are followed by your afflictions

Seneca continues his analysis of the relationship between traveling and self-improvement. While there are good reasons to travel (leisure and learning), self-improvement isn't one of them, because that requires critical reflection, wherever one happens to be.