CGTalk > Techniques > Texturing and Surfacing
Login register
Thread Closed share thread « Previous Thread | Next Thread »
 
Thread Tools Search this Thread Display Modes
Old 01-19-2010, 11:40 AM   #1
Hipe-0
New Member
 
Hipe-0's Avatar
portfolio
Mounier Hippolyte
Developper
Chatillon, France
 
Join Date: Jan 2010
Posts: 19
Thumbs up NEW 3D Texture extraction software from 2 photos: PhotoSculpt

Hi Guys!

I've just developped a software tool to extract 3d models and 3d textures from 2 photos with a different view point. Here is an image.

The project started as a curiosity 2 years ago but I've constantly worked on it and now the results are genuinely impressive, (well, I think):
- ultra high 3D depth resolution,
- really automatic
- incredibly fast
- export color, normal, depth, ambient occlusion, specular maps,
- export obj files too
- beautifull seamless tileable mode, crop, perspective corrections
- really fun user experience
- master the soft in 5 minutes

PhotoSculpt is the registered name, here is the pictogram.

And a newborn web site to accompany that :
www.photosculpt.net
(surprises will come there soon)

More Videos here:
http://www.youtube.com/user/hipe0

I'm still working and finalising the program. What are your needs? What are your expectations? Let's discuss!

Last edited by Hipe-0 : 01-27-2010 at 03:16 PM. Reason: Title change
 
Old 01-19-2010, 05:08 PM   #2
Stefanlp
New Member
portfolio
Stefan
Skopje, Macedonia
 
Join Date: Nov 2009
Posts: 21
I saw your videos and i must say, if those models were done only by the help of two pictures, then your program is really powerful, hope you continue working on it
 
Old 01-19-2010, 08:38 PM   #3
philnolan3d
LightWaver / 3D-Coater
 
philnolan3d's Avatar
portfolio
Phil Nolan
Generalist
Philadelphia, USA
 
Join Date: Jul 2003
Posts: 1,401
Send a message via AIM to philnolan3d
I've tried a number of these programs and none work very well so I'm sorry to say I'm skeptical. I also noticed none of the video show a wireframe.
__________________
~~Phil Nolan
3D Modeler & Texture Artist
www.philnolan3d.com
Sculpt first, Polygons later

 
Old 01-19-2010, 09:11 PM   #4
EricChadwick
Lord of the posts
 
EricChadwick's Avatar
veteran game artist
USA
 
Join Date: Sep 2002
Posts: 3,735
Well I'll bet the mesh is a regular world-space grid, which is kind of expected for a scanned mesh. You would usually re-topologize these to use them for animations, for example with something like CySlice.

I understand how you derive normal/displace/AO maps, but what process do you use for deriving specular maps? Maybe something similar to Crazy Bump... start with an inverse of the diffuse and tweak from there? Would be nice to have some more info.

Ryan Clark had a similar method for generating normalmaps from multiple photos, but his system required controlled lighting for each shot. I like that your method uses stereo photos instead, very cool.

Also reminds me of Microsoft's Unwrap Mosaics.
 
Old 01-21-2010, 08:15 PM   #5
Hipe-0
New Member
 
Hipe-0's Avatar
portfolio
Mounier Hippolyte
Developper
Chatillon, France
 
Join Date: Jan 2010
Posts: 19
Hi Guys, sorry for not replying sooner, (I'm sick and must stay in bed)

Eric, you're right that's a grid, but one that's so dense you'll not believe it. It's a very high quality of detail but of course I understand that such a grid cannot be used directly for production. I actually rarely or never use or save the grid itself, too big, I use a subdivision of it, I export maps, displacement maps, normal maps and stuff.
Retopo is the other option, my program don't do that.
Specular maps : I obtained good results with playing with a combination of ao and color(diffuse) map together.

philnolan3d: I will make one with wireframe for you and post it here

Stefanlp: thanks

I will post more soon when I get better, stay tuned!
 
Old 01-22-2010, 02:17 PM   #6
EricChadwick
Lord of the posts
 
EricChadwick's Avatar
veteran game artist
USA
 
Join Date: Sep 2002
Posts: 3,735
Looking forward to it. Hope you feel better!
 
Old 01-22-2010, 04:52 PM   #7
Jettatore
Violent Inner Peace
portfolio
Jettatore
USA
 
Join Date: Jul 2007
Posts: 902
Looks quite cool and useful, would love to play with it.
 
Old 01-23-2010, 12:29 AM   #8
LosPescados
Student
 
LosPescados's Avatar
portfolio
Tom De Vis
Student
Gooik, Belgium
 
Join Date: Jan 2009
Posts: 131
Send a message via MSN to LosPescados
This seems just awesome, gonna keep following this thread!
 
Old 01-24-2010, 11:43 PM   #9
Hipe-0
New Member
 
Hipe-0's Avatar
portfolio
Mounier Hippolyte
Developper
Chatillon, France
 
Join Date: Jan 2010
Posts: 19
Wireframe mode video is now online

philnolan3d, here is the video you requested with wireframe mode, does that replys to your question?

http://www.youtube.com/watch?v=e3pOIKsskq8

Here you'll see 400 000 tria maximum to get a fluid display for the video.
This model is actually a small square crop from the model displayed at http://www.youtube.com/watch?v=WaEP2RwDxVc

I have plenty of models in stock to display (about 10 000). Do you wish to see more? Any other questions?
 
Old 01-25-2010, 05:12 AM   #10
philnolan3d
LightWaver / 3D-Coater
 
philnolan3d's Avatar
portfolio
Phil Nolan
Generalist
Philadelphia, USA
 
Join Date: Jul 2003
Posts: 1,401
Send a message via AIM to philnolan3d
Oh I see, that's very nice. I like that you can change the resolution too. Looks like it would be a good match with 3D-Coat's retopology tools.
__________________
~~Phil Nolan
3D Modeler & Texture Artist
www.philnolan3d.com
Sculpt first, Polygons later


Last edited by philnolan3d : 01-25-2010 at 05:14 AM.
 
Old 01-25-2010, 09:48 AM   #11
Onethread
StereoMike
 
Onethread's Avatar
Michael Siegfeld
Germany
 
Join Date: Oct 2003
Posts: 65
Send a message via ICQ to Onethread
wow, impressive

I wonder what it looks like, when you try it with two photos of a face?
__________________
How can I know what I think before I hear what I say?
 
Old 01-27-2010, 10:32 AM   #12
Hipe-0
New Member
 
Hipe-0's Avatar
portfolio
Mounier Hippolyte
Developper
Chatillon, France
 
Join Date: Jan 2010
Posts: 19
That will work too for faces, but this is not an easy task, not for beginners.
I'll do a special tuto for this someday.

I can't wait to show you faces but please be patient. I need to 'hire' some friends that accept to be on youtube. Organise shooting when I get the time and so on.

Have you seen this already ?
http://www.youtube.com/watch?v=rzvN3qOeDPw
 
Old 01-27-2010, 11:48 AM   #13
Magnus3D
Expert
 
Magnus3D's Avatar
portfolio
Magnus Rönnkvist
Freelance 3D artist and photographer
Göteborg, Sweden
 
Join Date: Mar 2006
Posts: 1,347
Send a message via ICQ to Magnus3D Send a message via MSN to Magnus3D Send a message via Yahoo to Magnus3D
This looks very promising and interesting! however i wonder about one thing and that is if i can use more than two photos to generate a model. Say i got 12 or 24 or even 36 photos of a model from all different directions. Can the program process all those and more into a complete model ?

/ Magnus
 
Old 01-27-2010, 03:15 PM   #14
Hipe-0
New Member
 
Hipe-0's Avatar
portfolio
Mounier Hippolyte
Developper
Chatillon, France
 
Join Date: Jan 2010
Posts: 19
Red face

More than 2 photos is not possible now with the software.

I faced the following problem:
Doing it 360° is very difficult. Even shooting is difficult, you need to make sure light and everything is constant all the way. Turntable is not possible as that make the shadows move on the object = you cannot avoid artefacts. Also many problems to solve for the artist, models are often distorded and unusable, UV map is useless, that's at best days of manual rework. People that tried it can testify. I've discussed with a lot of them.

Well, as artist I don't want that.

My program is the opposite of that, I wanted it fast, simple to use, nice drag n drop enabled interface, nice uv maps, no stitching mess, beautifull seamless tileable textures of all kind, normals, displace, and all automatic.

I know you might be disapointed not to have the 360° option, but think of all those wonderfull models around you that you can get anyway even if you cannot turn around directly.

If you really want to, just make 4 models front/right/back/left and stitch them together. That's all I can propose now. Maybe one day I'll take the challenge to make it full 3D, who knows?

Hoping I've answered your question? This was an excellent question that many many peope ask. Thanks for your interest, ideas, suggestions? Please ask!
__________________
--
Hippolyte from www.photosculpt.net
 
Old 01-28-2010, 02:07 PM   #15
Magnus3D
Expert
 
Magnus3D's Avatar
portfolio
Magnus Rönnkvist
Freelance 3D artist and photographer
Göteborg, Sweden
 
Join Date: Mar 2006
Posts: 1,347
Send a message via ICQ to Magnus3D Send a message via MSN to Magnus3D Send a message via Yahoo to Magnus3D
Thanks for your reply Hipe, i appreciate it!

Yes you're right that the light is not uniform all around the object, but i don't think it matters that much. In some cases yes it's important but sometimes you just wanna capture the shape and the textures does not matter.

Your program looks good as it is already but i'm thinking about future developement, to where you could take this application one step beyond to make it even better.
Maybe it's something you can think about for future versions of your application, run some surveys online and see if people would be interested in full 360 capturing with the non-uniform lighting and other drawbacks it offers, that way you know if more people besides me have a interest in it and if it's something worth spending time coding.

Thanks again for your replies, and don't worry.

/ Magnus
 
Thread Closed share thread



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
CGSociety
Society of Digital Artists
www.cgsociety.org

Powered by vBulletin
Copyright ©2000 - 2006,
Jelsoft Enterprises Ltd.
Minimize Ads
Forum Jump
Miscellaneous

All times are GMT. The time now is 11:31 AM.


Powered by vBulletin
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.