I think it just so happened that I only ever clicked when I was close enough for it to spawn at a point where it looked like it was carrying it. If you click and hold the mouse you can move with it transparent so it was almost like I was moving it around haha