Hmm, well I'd imagine the problem is the general public finding out that Dan is being given preferential treatment, honestly. While there very likely is proof of world hopping taking place, it's also likely information that's pretty secret.
At least that's what I'm assuming would be the case granted some of these mysterious individuals could track you arriving at their world, yet people don't know it's a thing.