IMO it could only add value if there were rewards from doing so and no huge negative feedback from the game. What I mean by the latter is the game would punish you heavily so you couldn't complete the game or at least enjoy the game because of attacking villagers.

OTOH if the punishment were light such as the villagers would retaliate and close off their village, at least from you, it shouldn't hurt gameplay too much. Player could go to other villages if they need to trade or do anything no offensive.