that last coin is collectable… the trick is figuring out why it disappears when you go close. There are actually 2 coins with similar but different behavior.. which ever one you had issues with, and one other. Sounds like you solved the other one.
Sorry to hear about glitching out of bounds. Apparently there is still at least one wall clip glitch still in the controller.