I managed to somehow overwrite the castles with numbers. Resetting the puzzle did not return the castles. I did not screenshot it because it looked like pretty much what you would expect. I was filling in numbers and mis-clicked on a castle space to trigger the behavior.