What are you clicking/doing? Are you using the same client/ip/port as you hosted? Are you using a different computer than your own to join?
