For your consideration:
It would be so much easier if you could run and crouch when moving using the mouse buttons as well.
Also it might be nice if when you have found and equiped an item, it would change colour (I'm assuming you need to find/equip an item before you can equip via the TAB menu). Or are all items destined to be needed for quests eventually.
Finally whilst I don't mind the guards taking your money when they catch you, it might be good if you could stash it somewhere (perhaps around the staue or enterance gate). I'm guessing from the story-line there will be an endpoint at somepoint relating to the amount of money collected/earned.