Actually, I think I ran into that too. I played the Duck minigame once and even after it said I was clear, it didn't clear the Ducks, after playing a second time clearing every duck possible, I was then granted access. Hope this helps.
