Had time to test if it's a problem with RAM.
The good news, my system doesn't freeze anymore.
The bad news, the H scenes still drop frames.
I think it's a problem with SteamVR. At least I can enjoy the conversation and fighting part xD
It was most likely caused by the H-scene animation system.
The animation system was changed in Ver 1.10.