Yeah the character controller is not really optimal for a circle collider. Just realized it would have been better to use a polygon collider with straight lines. Oh well, now i know :)