if you kill a monster it shouldn't appear when you go back to the place you encountered it, makes backtracking a hassle.
Have you played on stable or unstable?
stable
Try unstable build.
