I did mean buildings like the witch hut but I also meant terrain like the lake and the mountain. though those might not be bad for the game as they can serve as an obstacle for people trying to go for the shortest time.
also I really liked that, as soon as you figured out how to win consistently, the game changes to "how do get as much score as possible without screwing my chances to win" makes it really replayable