The rooms can be improved at the building table. Although, a lot of rooms don't have upgrades right now, but you can build some new rooms.
