In the v.0.0.6, both missions and cultivating consume moods on top of annual deterioration. The only way to stop the plummeting mood would be either resting, free time or hoping for random events that would grant you mood bonus.
It would change in the next version.