Thanks! Sometimes, if rabbits don't spawn near flowers, they'll go away automatically. Their hitbox is pretty big though, so you might have been scaring them away without trying in the beginning :P
