To progress your relationship, you need to spend time with him on weekdays too. Don't just spend time on weekends. The "important scenes" will be triggered on weekdays' events. No matter how high your love meter is, it will be useless if you don't spend time on weekdays.
Hi
I've spend the weekdays with him from Jan to July, currently I've already done the camp event and there's no changes no matter how many times I've gone out with him during the day (VA room, Agency and Park, been to all of his usual places any chance I got)...
Just another note, Haato's name changed to none the moment he went to camp and it has stayed as none after