Try the mouse scroll while hovering the mouse cursor on the tilesheet window.
There is also a new option to decouple its zoom from the tilemap window, from the top menu: View > Limk map & tilesheet zooms
View > Limk map & tilesheet zooms