This reminds me of "I am bread" or "Octodad" where the controls and intentionally difficult to test the player patience and get them all flustered.
I think with more levels and varied gameplay you have a solid idea for a project here.
Do you have plans to continue development?