Figured it out. It's the number of cards on your side of the field in all spaces to the left of them (for one side, right of them for the other).
