There are some places that you simply cannot do that i.e bathroom/restaurant. If you have enough points but still unable to do it in bedroom/living room/ kitchen, then please send me a screenshot or some details of how you got there. It will help me a ton!
You don't need to keep track of it manually, all info is in the characters tab.
Let me know if you need any other help!