For now we don't know how huge those consequenses are if we decide to feel aroused by him and serve him or not, then again Hyao added the Plains of Death event with also the intention if some people lowkey regretted their choice to serve him and can somewhat change their 'relationship' status.
If you choose to serve him like I did then you still have the chance to refuse his sex offer, he will then look at you a bit different..