Oh wow, it's cool to have an insight into how you're doing it!!
The idea I had to simplify a bit the "pixel hunting" a bit was to have the area be quite a bit bigger (4x maybe? Must be play tested! Shouldn't be too easy after all!) and when "F" is pressed the camera can smoothly move to a better predefined angle! I don't know if this is an idea you already considered and discarded, just felt like sharing anyway!
I love when people work in these sort of cryptic systems ahaha makes it way more unique by itself already! Thanks for taking the time to reply!