Thanks a lot for playing it! Yeah it's a bit unfair at times and I contemplated adding an extra key to make up for the one the garden consumes if you don't figure out the hidden puzzle there.
Try... pushing the plant in a specific direction to complete the pattern. Thinking back... I should have used the pots for this. Bad design on my end there.