Are you using a game engine? I use Godot which lets me make different layers for tilemaps, that way you can have a tile layer for the water under the ground tiles. Sorry if I misunderstood, and this was not the help you were looking for ><
I didn't watch the full video but this one seems to explain it pretty well :
if you use a different game engine there might be a similar solution ><