I was inside a building with the camera, as far as I can tell, and I would still fall through the building.
First Person will always fall to the level; of the terrain. Then follow the terrain. It will move around rocks,.
FP apparently will go through other objects as though they are two dimensional paper. object.
This could be considered a big enough bug to report it.
I will try reporting it tomorrow.