Oh yeah this would really benefit from expansion!
I mean it took me a while to understand when the creatures appear to the PCs, if they can just see them or they emerge when they arrive at a location. I think I figured it out but it was looking around a bit too understand how the encounters would come about