Goal. I have 2d talikng footage of a cubist head similar to this:
That is already comped together. I need to face paint it so the paint follows the distortions of the face as he talks. I have wasted days trying AE face tracking, Mocha, and others to push puppet pins, overlay with displacement maps, and other 2d tools. It’s not working.
If I am forced to expand into a 3d workflow, I see two possible paths forward:
-
Paint the already comped cubist face (alpha 2d footage): Comping it together required some liquid distortions in AE, so if I could just paint the finished comp as a single face, it would help hide those distortions where cheek skin doesn’t quite move correctly at junction with nose, etc.
-
If I need to do this via facial tracking, and if those trackers just won’t work with the cubist face, then I suppose I could paint the front and side footage separately, then reassemble them into the cubist mashup after they are painted. (Not ideal as the liquid distortions required to do the comp would be more visible since I’m now stretching the paint.
What’s my best bet for getting this done in next 48 hours? Spark AR? Lens Studio? Nuke? CrazyTalk?
Only tools I’ve already got and familiar with are AE, Mocha, C4d.