I finally figured it out. In blender I had to change the rotation axis on the upper arm bones from auto to X manual.
