It's been months since I last used unity, but I'm pretty sure the engine has a collision layer feature. If you set the ghosts and the bullets on different layers, and then indicate that those layers don't interact, that should solve the issue.
Oh im gona try it and see if it works, thanks 🫶
