It would be EXTREMELY difficult to do this with layers. Anything is possible, but if it were me, I would do everything in my power to only use objects.
I figured as much. Thanks for the quick reply!