Crossing the uncanny valley WIP

Become a member of the CGSociety

Connect, Share, and Learn with our Large Growing CG Art Community. It's Free!

Thread Tools Display Modes
  11 November 2011
Lightbulb Crossing the uncanny valley WIP

latest update :

__________________________________________________ ______________________
So, this is gonna be sort of a making-of'ish, tutorial'ish thread on how to create an accurate face scan for anybody, basically all you need is a digital camera and internet connection.

So for me the plan was to create an one-to-one digital copy of a real life protagonist (from the neck up) for a DIY facial mocap later on.

To the scanning part, i came across a free service provided by autodesk called Project PhotoFly (im sure many of you heard of it and tried it). The quality of output this service provides is imho mindblowing.

The first crucial step is provide photofly with enough data

I shot about 90 to 100 18 megapixel photos from every possible angle.
They were shot with 50mm portrait lens. I aimed for shots as sharp as possible with minimal depth of field (f/8 ; 1/250s). I also found myself getting much better results with more closeup shots (on mouth area, eyes area, nose area etc) in stead of trying to fit the whole face into the image like most people do. The difference in quality was really significant

This is how the model look in photofly viewport:

This image is only for illustration purposes. The golder rule is 'less is more' so i didnt use all my taken photographs, i just used around 50 photos, its a kinda trial & error process, choosing and uploading different photographs and checking the model if the geometry is glitch free and clean. And if its not , then figure out which photo is causing problems and remove it, or manually restitch it

This is the final scan i end up working with:

Not bad for a free and easy solution if you ask me not bad at all. The texture is ok too
The eyebrows and eye area will always cause problems because of eyelashes and facial hair, but thats absolutely fine.

Some minor retouching in zbrush with the trim dynamic brush and smooth subdivision, which works like magic, smoothing the surface without destroying nice details

And of we go to topogun for retopology...

Last edited by kybel : 06 June 2014 at 02:47 PM.
  11 November 2011

Before starting the actual retopo process, i marked out some key features i wanted my mesh to follow. Besides the obvious ones, like mouth and eye edgeloops, i also wanted my mesh to follow the jaw line, the nose-labial fold, the nose geometry collapsing on the bridge of the nose so the forehead geometry would be clean and smooth

The final topology looks something like this. i tried to make the polygons as even as possible. i must say im pretty happy with the end result. The trouble areas like the mouth nose and mainly eyes will be modeled in maya by hand

The exported model looks very clean, smooth and organic, the anatomy underneath the skin is well defined, and thats everything i was hoping for
  11 November 2011
Another awesome feature of photofly is that you can export not only the generated mesh, but also the whole scene with every used camere, so you can then model the face from many many angles and lock it dead. Much more accurate than using orto views i guess

Imho the retopologized mesh is about >95% accurate with the actual real life protagonist

All you need to do is chose the desired camera and import the imageplane accordingly. and trust me, youll have plenty of cameras to chose from

Hint : another neat way of preparing a scene for modeling is by using PFTrack,but thats a different story

  11 November 2011
I also did a small side quest, and exported normal, displace, occlusion maps on a uv'd model
then i combined the extracted geometry-normal map with texture-normal map (using crazybump) for high fidelity details. the results again look pretty neat:

Next up : good'ol fashion modeling
  11 November 2011
This looks fantastic! Can't wait to see more of it!
  11 November 2011
Incredible! This is pretty cool and ever more so, because it's free! Keep them coming...

  11 November 2011

this is how a crazy person prepares a scene for modeling. ,)

Last edited by kybel : 11 November 2011 at 11:38 PM.
  11 November 2011
building the eye geometry.

mobile workstation + big external monitor = my best modeling experience ever
  11 November 2011
I'm following this thread with huge interest. It seems that the tool is really working great and the model already has a big resemblance. Makes me want to check it out myself. Keep us updated...

  11 November 2011
the left eye geometry is finished. im pretty happy with it so far.
only minor adjustments left to do

fits like a glove ,)

  11 November 2011
Wow, this makes a really nice looking normal map. This is really interesting. Thanks for sharing
  11 November 2011
I've just finished the geometry for both of the eyes.
Next up, wrap up the nose and mouth to complete the face

  12 December 2011
i finally had some spare time, and so i did some minor modelling to finish the nostrils and mouth and adjust a thing or two

Its just a detail but it brings out the character so much. after doing this, i can definitely feel the very accurate likeness in the face...which is kinda creepy since the guy is sitting right next to me.

and like before, the model still sits very very nicely

some big quests before christmas ahead. but after that i cant wait to start with the ear 'scanning' and modeling.

* C&C are of course welcome
  12 December 2011
I don't know how realistic you're going, or how close up you're going to render, but I might suggest building the tear duct as a separate piece of geometry. It'll handle your shaders and blinking better. But only if you will ever be up close enough to notice it.
  12 December 2011

now when im thinking about it... i just NEED to do so. the shaders are one reason, and also during animation and eye rigging it wont be getting in the way.

great suggestion thanks a lot
reply share thread

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Society of Digital Artists

Powered by vBulletin
Copyright ©2000 - 2006,
Jelsoft Enterprises Ltd.
Minimize Ads
Forum Jump

All times are GMT. The time now is 05:16 PM.

Powered by vBulletin
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.