Forcing me to have all character enter the place is kinda lame
What you mean?
Old version, In newer versions you can deny access
