I just tested the game once more with that control scheme and everything seems to be working. When isn't the controls working? Since each player can only move in two directions they can also only interact in those two directions. Maybe it was what threw you off?