We just updated the game (patch 2) with tweaked balance and an indicator showing orbs that have been "loaded". Hoping this will improve gameplay!
