There's a bug where if you're moving and cast a spell, and continue to hold your movement input while the spell animation is playing, your spell dots will become disjointed from your player character. This does not affect the invisibility spell as your character isn't locked into an animation. This doesn't work if your player is walking into an object.