Since the next release will be dedicated to small things around the castle, I'll try and find the time to fit in some quality of life features like you suggested. And I think only Fabian's got that problem, but it's somewhat intentional
There are some fast travels now but they are unlocked at later stages of the game. If anyone is reading this and having trouble with the bridge, it is on the third floor of the Western Building (the one you start in).
