The concept is pretty cool. The whole place-changes-when-you're-not-looking idea is a good one, and when the wall shifted behind me, that was a great moment to break out of the little room. I did get a little confused about what was actually dangerous at first, but after reading your explanation, it makes more sense.
There's definitely something here. With a bit more clarity and polish around the mechanics, this could turn into something really tense and memorable.