Could you provide some more details on what you mean by Ctrl and Alt modifiers in Edit mode?
Basically, I want to be able to select just the relevant tiles instead of the ladder and the wall behind it. That's hard to do when my only option is click-and-drag.
If a tile is inadvertently added to the selection, you can use Shift + Alt + Left Click to remove it from the current selection.
Thanks.