I wonder if since you have blender and maya skills if it would ever make sense to animate a face to feed as the input, or if it would always be better to manipulate the face directly at that point.
i think this will be much, much easier. Currently this will modify video, not mesh, so if you have a 3d environment, thats fucked. If you have a render of a 3d environment, then cool. Experiments i wanna try, using the VR camera in maya and rendering a person and seeing it if can stall animate it with the distortion. Doing a 360 around a character and see if it will cut off when the face is no longer visible. Just woke up and havent had coffee, so i dunno what else. https://files.catbox.moe/69u7b2.mp4 here is a very short vid to vid i made using their source videos, nothing cool. I'm rendering out a 3020 frame image sequence (over night) and i'm going to try to reinterpret that through the LCM for a bike shop's after hours party that they have once a month. I was a bike judge for a bike show! ^^ My judging criteria was, "Is it a boat?" Way better then my original idea, "Seat smell?"