Playtesters are often right about what’s wrong, but wrong about how to fix it. So take this with a grain of salt.
I think the issue might be that the “doormat” looks a bit too plain. Maybe you could add some subtle dashed lines or a diagonal pattern to make it stand out. When the player steps on one, a small progress bar or circle filling up could help indicate that they are supposed to stay there for a moment.