I have exactly this problem on macOS.
Controller (XSX) only works until I press any of ABXY buttons, after that it loses input until I press "Start" button - basically unplayable.
Same on Steam and itchio versions. Latest gamepad firmware. Latest game patch. Gamepad works perfectly fine on other titles.
lmk if more info needed!