I was lucky enough to be a beta tester for a cool new plugin from Cineversity: CV-AR.
CV-AR has two components: an iOS app that works with the TrueDepth Camera of the iPhone X to do facial motion capture; and a C4D plugin that takes that data and makes it available within C4D. Donovan Keith has an intro tutorial up on Cineversity at:
The free iOS app is available at:
The iOS capture tool leverages Apple’s ARkit to provide realtime capture of 51 facial movements, as well as eye orientation and head position.
The plugin is a blast to work with. The initial textured mask you get lets you know how well the performance was captured, but that’s just the beginning. You can then use the blendshape strength data streamed from the capture object to drive your own rigs. I think it has real utility for animators, both as a way to provide reference for hand-tuned animation, and as a way to speed a more automated animation workflow.
Here is a sample movie with the capture object mask on the left and my rig driven by that data on the right. At this point I hadn’t quite nailed some of the morph target sculpting, and the head movement needs adjustment. Let me know if you have any questions about how this works…
Props to Kent Barber for developing the plugin, and to Rick Barrett and the folks at Cineversity.