I think I'm having the same issue, not sure if it's because I'm clicking too quickly for the arrow to appear, it seems to happen so often that I can't find anything for 20 seconds and can only wander around the map waiting for the bug to go away so that the arrow can appear to find the mini-game.
