PDA

View Full Version : Renderfarm experiment, part I


RenderFred
09-15-2005, 03:08 PM
This is part I of my renderfarm experiment with Vue 5 Infinite build 278257. The chosen scene is the well-known Sponza.

The goal of this experiment is to test V5I renderfarming abilities with stills (part I) and animations (part II). I hope it will be helpful for users who want to build a rendering farm, and also for e-on in order to improve this important feature.

In this experiment, I used a 10 PCs renderfarm. I added each PC one after the other in order to record additional gains.

Please be aware that V5i is relatively inefficient for still images parallel rendering when fast and slow PCs render at the same time. V5i does not determine at rendertime what are the "hardest" tiles to render, so if a very slow PC gets a very hard tile, it will continue to render long after all the others have finished. The renderfarm could actually render faster without the slowest PCs ! If all the PCs on the network have the same rendering power, of course the problem goes away.

This problem could be dealt with simply by allowing manual allocation (by the user) of the number of tiles. With small tiles, even slow PCs would not get stuck too long, particularly in small renderfarms. I hope this option will be implemented in future versions of V5i.

In each case the Manager was running on the fastest PC (Opteron). There was no noticeable delay to transfert the scene and the textures to the other machines on the network (a few seconds max).

Sponza scene, ultra rendering mode, render to screen, 1024 x 768 pixels.

PC 1 added (Dual Opteron 275 @ 2442 MHz) : 40 mn 24 s - 4 tiles
PC 2 added (Dual Xeon @ 2800 MHz) : 33 mn 14 s - 9 tiles
PC 3 added (Pentium 4C @ 3200 MHz) : 23 mn 08 s - 16 tiles
PC 4 added (Pentium 4C @ 3400 Mhz) : 20 mn 14 s - 16 tiles
PC 5 added (Pentium 4C @ 3300 Mhz) : 18 mn 34 s - 25 tiles
PC 6 added (Pentium 4C @ 3300 MHz) : 16 mn 09 s - 25 tiles
PC 7 added (Athlon 64 @ 2450 MHz) : 14 mn 58 s - 36 tiles
PC 8 added (Athlon 64 @ 2400 MHz) : 14 mn 11 s - 36 tiles
PC 9 added (Athlon 64 @ 2400 MHz) : 13 mn 33s - 36 tiles
PC 10 added (Athlon XP @ 2250 MHz) : 12 mn 03 s - 49 tiles

So the entire renderfarm completed the job 3.35 times faster than the fastest machine. It does not seem extremely impressive, but you will see that kind of result if one or two machines are clearly faster than the others.

Note 1 : I had many crashes (V5I goes back to desktop) at the beginning of rendering. It seems to be a consequence of running repeated renderfarm runs without quitting and reloading the app first. The first time it occurred was after adding PC 5. I reloaded V5i and the Sponza scene and all went well. It seems that repeated renderfarm runs are difficult to handle by the program if you add new PCs one by one, and then render. If you add all the PCs you need in one run (this is generally the case) there is no problem.

Note 2 : the display in the 'RenderCow Status' of the HyperVue network manager is rather strange. At the end of a render, you get the impression that many PCs are rendering the same tile, which is obviously not the case. I think it is a display bug. Has anyone noticed this ?

Part II of the experiment (in a few days if I find the time) will use the same protocol but with an animation. In that case images are not cut into tiles, but each frame of the animation is sent to a different PC. Efficiency should be better, as the complexity does not vary much between frames.

frank10
09-16-2005, 10:14 AM
Thanks for the tests.

Have you purchased an extension for the render nodes?
Because I seem to remember it was 5 nodes with the standard Vue5i.

The test shows also that speed increased at 2x when you added only 3 nodes on 10. that's because of the major speed clock in the first pcs and I suppose the dual Xeon. Does vue use the two cpu, isnt it?

RenderFred
09-16-2005, 11:31 AM
To use more than 5 nodes you need to buy an additional pack.
Vue 5 Infinite uses as many CPUs as you have. As the Dual Opteron 275 is really a quad (two dual core CPUs), it is seen as 4 CPUs.

kevinriley
07-24-2006, 03:51 PM
Hey guys,

DO you know of any render farms that support Vuexstream utilizing MAX 8---I love the renders I'm getting, but projecting mathmatically, I will not be able to render my 2 1/2 minute animation at 15 min. per frame in the time I have alloted...thanks so much for any assistance you can give me!!

freakybusiness
07-25-2006, 12:41 PM
I just wanted to say thankyou to Frederic for researching and posting this info. I am looking to start a render farm early next year with a variety of old and new computers so this test was particularly handy. I always look out for your posts/animation tests and appreciate them greatly. I hope you will continue your research with Vue 6. I've already ordered my copy - not long to wait now! Whoohoo!

IvanB
07-27-2006, 09:58 AM
Hey people...Thanks for the info, I was wondering if someone can help..I'm looking to set up a render farm, and am in the process of purchasing some pc's. What I need to know is how the amount of ram and the size of the hard drive effects the farm..What are the minimum requirements of the ram and the size of the hard drive for it to work correctly? The processors are going to be about 2.5Mhz..
I have been experimenting with 2 pc's (desktop and a laptop) for now, and I'm not sure what it is should be seeing in the render window. Should I be seeing both pc's or just the one Im connected to..It takes a long time to send the scene and textures, but once going it seems to almost half the render time. Sorry if this question is stupid, but I cant seem to find any info on this.

Thanks Ivan.

BoBoZoBo
07-30-2006, 04:34 PM
I am so glad you have started this because I LOVE Vue but I get a little frustrated with the HyperVue renderfarm abilities.

Currently I have 4 systems setup in a renderfarm

1) AMD DualCore 3800
2) AMD 3800 (single Core)
3) Intel4 9with HT) 3GHz
4) Intel4 3GH

I seem to be having the same issues you have with it.


Note 1
I also have notices that if you do not restart ALL rendercows across all the systems before doing a massive final render, you will probably either CTD or it will render all the tiles, THEN crash when trying to composite the tiles. It works BEST if you just loaded the scene and new rendercows and hit RENDER.

Sometime I also have issues where sometimes textures are not sent to one system, the results are interesting but useless.


Note 2
I only see this redundent tile rendering at the end of a render, where I may have 3 systems rendering tile 16. It does not bother me as they are not doing anything anyway and maybe could render faster.


As far as Animations I have tried a few small ones (30sec @ 300x200) and have similar issues. Each system renders a frame and it does a better job fot the most part. But there is always that chance as with the tile rendering.

I hope Vue 6 rendermanager is MUCH better and may they can inegrate it with other popular render managers


Questions:

Are there any other render managers that can handle Vue better?
Can I got Vue RenderCow to take advantage of both cores in my dualcore system?

CGTalk Moderation
07-30-2006, 04:34 PM
This thread has been automatically closed as it remained inactive for 12 months. If you wish to continue the discussion, please create a new thread in the appropriate forum.