Were you on mobile? I've noticed the action-cancelling issue on touchscreens but not on the mouse.
I will probably change the draw/discard piles into clickable icons instead of hoverable numbers in a future update.
Glad you enjoyed! Thanks for playing!