Yes, if you roll a 1, you get to reroll and thus negate that 1. The Travel guide stays.However, if your second reroll is also a 1, you must keep it. Then the Travel guide would leave.
