I've just checked out and tested weapon swapping. You can definitely swap between weapons while firing. The only exclusion is firing and devouring.
