Go to the temple at night
I believe you also have to do this after completing or failing a pact once.
Ah, thank you!
