Your perception needs to be higher than 5 for you to be able to approach him. Unfortunately in this build there is not much you can do to improve your stats (I'm planning to implement leveling up in the next update). Making Focus Tea is the only option right now - it improves your perception by 2 for like 180 minutes.