If the map ever gets bigger, I really do recommend a map button to show where you and POIs are. I wasn't paying attention to the building you walk out of and my entire first day was spent walking up to random buildings until it happened to be the correct building (or at least give some indicator on the building like the photography and clothes shop). Being able to see where purple guys are/what "quests" you've accepted are would be super useful as well.
I also would like to add again like others have mentioned, it would be very useful to give some indicator of who you've already photographed, so you don't waste time chasing them down only to realize you can't take a photo. Maybe make them a different shade of pink or anything to indicate it.
Those are honestly my biggest suggestions, besides fixing the "getting caught immediately after hitting E/left-click" bug.