make sure the terrain collision mask layer and grass collision mask layer is the same.
i read your reply very late. i exported the terrain mesh again as aan obj file rather than gltf2 from blender. that somehow solved the issue.
I'm also using a .obj, maybe that was the issue who knows?