I was thinking in porting this template to Godot 4. The main change would be in the AI movement of the enemies because the way the path navigation system works in Godot4 is different.
Anyway, in my opinion, if you aim to make 2D games, Godot 3.5 is fine. The big improvement of Godot 4 is the way the engine works in 3D games