Hm, the stick must be triggering button #2. I think the internal joystick settings may not be set up correctly for the CPC. I have an ArcadeR stick too so I know it works, but I had to swap the ribbon cable on the inside of the stick from one connector to the other before I could use it as a 2 button CPC controller. IIRC it comes from the factory in C64 configuration.