You're right, you only need to remove the duplicates and the die will stop giving you penalty. For example, I have the board as below and the 6 is giving me penalty. I will need to remove one of the 9s in order to stop the penalty. My tutorial is a mess so I hope I have cleared any confusion now. Hope you had fun!

