PDA

View Full Version : Automated photo/video modeling: production journal


backwheelbates
09-05-2010, 01:09 PM
I've been doing a bit of research and experimentation into automated methods of modeling from photos/video and I thought I would share some of my discoveries/progress here.

This is a mixed medium project, and in this case my goal was to automate the modeling of stand-in/proxy model. So obviously this approach wont work for all purposes, but I found it quite quick and relatively accurate (might also be good process to create a base mesh for further modeling as well).

Overview video;
http://vimeo.com/14708436
14708436

For the 3d reconstruction I tried several applications, only 3 really worked for this purpose;

Vi3dim
vi3dim.com/ (http://vi3dim.com/)
(pretty amazing $20 program)

pros
-cool factor
-quick
-pretty accurate
cons
-poor concave surface reconstruction
-registration matte is limiting

Autodesk Photofly
labs.autodesk.com/utilities/photo_scene_editor/ (http://labs.autodesk.com/utilities/photo_scene_editor/)
(free)

pros
-completely automated registration
-quick/accurate
-need only to upload your photos
cons
-wasn’t able to reconstruct some parts
-point cloud detail was low
-only able to scan one side at a time

Microsoft Photosynth
photosynth.net/ (http://photosynth.net/)
(the clear winner, oh and free)

pros
-”synthyness”
-upload photos/completely automated
-accurate/dense point cloud
-even reconstructed convex areas quite well
cons
-no export/”hacky” to get data

In the end I decided to use the data from Photosynth. Although exporting the point cloud was a bit technical. There are a couple of ways to hack the data out of the Microsoft servers(hopefully an export feature will be added soon);
binarymillenium.com/2008/08/photosynth-export-process-tutorial.html (http://binarymillenium.com/2008/08/photosynth-export-process-tutorial.html)(I used this process.)
synthexport.codeplex.com/ (http://synthexport.codeplex.com/)

Lastly there’s a great free tool called meshlab, that does a great job of rebuilding a surface from the point cloud. I was able to export an obj and send it right to Maya. Here’s a great guide for meshing your point cloud in meshlab;
meshlabstuff.blogspot.com/2009/09/meshing-point-clouds.html (http://meshlabstuff.blogspot.com/2009/09/meshing-point-clouds.html)

Ok, time to get back to work. Comments and questions are much obliged!

Check my blog for more pics and info;
eric-bates.com/?p=1302 (http://eric-bates.com/?p=1302)

http://www.eric-bates.com/doraemon/wp-content/uploads/2010/09/crabSketch_bodydetail-585x329.jpg
http://www.eric-bates.com/doraemon/wp-content/uploads/2010/09/crabMaquette_004-585x329.jpg
http://www.eric-bates.com/doraemon/wp-content/uploads/2010/09/3d_006_photosynth-585x329.jpg
http://www.eric-bates.com/doraemon/wp-content/uploads/2010/09/3d_008_maya-585x329.jpg

Dare-o
09-05-2010, 08:06 PM
very cool. :)

backwheelbates
09-06-2010, 10:27 AM
Hey thanks Dare-o! Ya its pretty amazing technology, but I don't think modelers are out of a job yet though!!

Cheers.

Psyk0
09-06-2010, 01:45 PM
This could be really helpful to quickly knock out a proxy mesh to rebuild topology on top, cool stuff :)

CGTalk Moderation
09-06-2010, 01:45 PM
This thread has been automatically closed as it remained inactive for 12 months. If you wish to continue the discussion, please create a new thread in the appropriate forum.