CV-AR: Easy facial performance capture with iPhone X

Become a member of the CGSociety

Connect, Share, and Learn with our Large Growing CG Art Community. It's Free!

REPLY TO THREAD
 
Thread Tools Display Modes
  1 Week Ago
That looks quite good for the hardware, did you tested some speech to see if the mouth follows?
 
  1 Week Ago
Originally Posted by Bullit: That looks quite good for the hardware, did you tested some speech to see if the mouth follows?
There is an example with lip sync in the original post... the short answer: lip sync can be quite good, but is also sometimes not so good, and some phonemes will usually need need tweaking (esp plosives). I still have to test whether the capture data comes in at 30 or 60 FPS, which would make a difference. Also, ARKit does not track tongue position, so that would have to be added manually.
 
  1 Week Ago
Originally Posted by NWoolridge: There is an example with lip sync in the original post... the short answer: lip sync can be quite good, but is also sometimes not so good, and some phonemes will usually need need tweaking (esp plosives). I still have to test whether the capture data comes in at 30 or 60 FPS, which would make a difference. Also, ARKit does not track tongue position, so that would have to be added manually.
Upcoming AR kit added tongue tracking...so perhaps that can be added to a future version of plugin.
__________________
C4D R19 Studio, MODO 902, VRAY, Octane, Cycles. PC/Mac.
 
  1 Week Ago
Originally Posted by NWoolridge: There is an example with lip sync in the original post... the short answer: lip sync can be quite good, but is also sometimes not so good, and some phonemes will usually need need tweaking (esp plosives). I still have to test whether the capture data comes in at 30 or 60 FPS, which would make a difference. Also, ARKit does not track tongue position, so that would have to be added manually.

For version 1.0 the capture rate is set to 30 FPS.
 
reply share thread



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
CGSociety
Society of Digital Artists
www.cgsociety.org

Powered by vBulletin
Copyright 2000 - 2006,
Jelsoft Enterprises Ltd.
Minimize Ads
Forum Jump
Miscellaneous

All times are GMT. The time now is 08:35 AM.


Powered by vBulletin
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.