That's right, you'd fill that empty spot next turn. And, unless the card that you fill that spot with also has a destroy effect affecting a card in the fort, the game would end after you place it.
Pretty much the only time you're left with empty spots in the fort is if you've run out of cards to put in.