You actually can rotate pieces that are already placed! You need an empty hand first, by clicking on the wall you have selected again or pressing Q over an empty space. Then hover over the wall you want to rotate and press R or Shift-R!
Thanks for playing, and for the comment! :)