Oh and just 30 seconds after posting this I figured out that I needed to target the ghost's placement rather than use B to activate it haha.