Hi alderpaw. Yes, you have to configure the tileset by yourself. I have small pic for the textures. Maybe it helps a little bit. :) 
Viewing post in Questions about setting the passage of tileset
I will add some texture passable configs in the future with pics.
But it's really easy in RPGMaker compared to other engines.
However, you have to be careful with some A4 walls as they are not considered walls in RPGMAKER, the character can still walk on them from below despite the "X" as I simply wanted to offer as many textures as possible. You can easily prevent this by placing a window or any tile (can also be empty) with an X on the bottom so that the character cannot walk on the wall from below.
If you have a Discord, you are also welcome.
There is a large Discord with 250 people for my tilesets where you can also exchange ideas with each other. :)
I hope I could help you.