I think it's due to my "filter" for the atmosphere. I'm using a sprite of a certain color with low opacity that covers the entire screen to give that atmospheric effect. This must be affecting the depth of the shadows. Thanks for the feedback.