There is a message that doesn't let me go down intothe lava land
Lavaland is not accessible until you reach the fortress. Also you can't walk on it while on big form.
When in doubt, you should go where the flag is.