Ah, thank you!
I had done some custom styling so that an image from the description overlapped with the header image in a nice way. After the button showed up, the layout looked broken. However, having the button up there does seem pretty handy - I was just confused that it seemed like you could disable / enable it but I couldn't figure out how!