From what I've seen this is an issue with Unity, particularly Unity 5. The lighting system is weird and it takes a lot of tweaking to get things right (especially when you're up close against things like walls).
