I'll get back into development next week, so I'll have a closer look at it then.
Seems to be an issue with realtime shadows form what you describe.