I've been playing for many days and my relationship with him is stuck at 40. The dialogue box says there's a way to increase affection, but after checking, the value is still stuck at 40.