Ah yeah, it's all coming together

Here is a video of the code in question running in real time on a video of family guy. Still needs some bug testing and such but major progress so far