I think all the games might be in different alternative universes
Spoiler alert!
So do I, it would explain why the town is very different from the crowscare game and the cemetery Mary one. In my opinion, I think the relation between those games is like the one between the FNAF games and books. It's not the same universe, but we can find some lore in it. Like the horn man guy, we finally saw his face, but there's still a lot of mysteries surrounding him. Anyway, I expect to find more informations about him in the next games.