The game doesn't explain it but you can hold the Space key when next to a candle to pull it away from a wall