It took some time, but I just updated the game to overhaul the Observation system, which might alleviate some of your problems