Right now the game uses a default port, so you should only worry about the local IP of the host.
When you say you were unable to play with 4 people, could you still play with 2/3 players or couldn't you play multiplayer at all?