After a lot of retries I got it!
I would love an easy-mode where you'd have a collection of minimaps that show all the places that you've mapped in the current run, but not necessarily in the correct order relative to each other so that you'd still have to puzzle it yoursel (I do understand while writing this that this would be a big scope increase though 😅)