Thanks for the feedback! When switching/skipping characters, the time left, still gets deducted from all timers. So skipping with 4 seconds left on that character means every timer still loses those 4 seconds (including the timed doors).
Hope that makes sense!