It might just be an RNG thing, like sometimes you get more lucky than other times with how long it takes. There isn't a deciding factor that I know of for how long it takes Viktor to open the door.
