So you are using A.I to help make the artwork, but if I am understanding your description correctly, it is an A.I you created and everything you are plugging into the A.I is stuff you created from scratch. So your artwork, is the only artwork that is being plugged into the A.I art machine. Thus assuring that nothing it pops out was made out of stealing some else work. If that is a correct interpretation, as someone who is against the concept of A.I created art I could possibly accept that as some level of reasonable middle ground for someone using A.I in their art making.
Keyword being possibly. I am still going to be debating this in my head for awhile to figure out how I feel about it. But I promise if I decide dislike the idea I will not come back to attack you.