You can continue talking to people that aren't aggro'd onto you, you just have to avoid the ones that are.
If you mean all npcs were aggro'd then yeah you kinda have to let them beat you up hahaha
