Yes, you can fight through the ravagers to destroy the barricade, and then attack whatever building or token was on top of the barricade...
In testing, actually because they are so spread out the recruiting has actually been a little on the weak side... Hoping to get a bunch more testing in and try and get these guys to a stabler place. But they have been a lot of fun to play so far!