Distributed file systems in production?

Become a member of the CGSociety

Connect, Share, and Learn with our Large Growing CG Art Community. It's Free!

THREAD CLOSED
 
Thread Tools Search this Thread Display Modes
Old 08 August 2009   #1
Distributed file systems in production?

I've been following a curiosity of distributed file systems lately and while finding some answers I've ended up with more questions. Lustre seems like a good option being very mature, robust, and distributed under GNU GPL which is a huge plus. Not sure if this is true or not but some reports (found with Google) say Frantic Films and other studios have implemented Lustre and other distributed file systems for their production storage needs. If that really is the case, that's awesome and I want to know more.

The curiosity started when some render nodes were timing out with CIFS file requests when the file system was busy. Some large commercial storage solutions from several vendors are in use right now but frankly they don't make the cut in my opinion. Upgrading them is prohibitively expensive and their current capacity and bandwidth is insufficient for working with large assets.

Has anybody had any experience with distributed file systems? Was it in production or somewhere else? Have you set one up? If you work for a vendor it would be good to hear from that perspective as well. Cheers!
__________________
http://www.whenpicsfly.com
 
Old 09 September 2009   #2
So I've pretty much satisfied my quest for distributed file system knowledge which led me to researching the actual nodes or bricks in a cluster. I came across this link and figured some of the people on the technical forum would get a kick out of it.

http://blog.backblaze.com/2009/09/0...-cloud-storage/

Its an online storage company that makes their own servers. They've released the plans (including CAD files) and complete parts lists of off the shelf components to make the nodes. Pretty cool! Their focus is more on capacity than performance but the ideas could be applied in other systems. Cheers!
__________________
http://www.whenpicsfly.com
 
Old 09 September 2009   #3
Thread automatically closed

This thread has been automatically closed as it remained inactive for 12 months. If you wish to continue the discussion, please create a new thread in the appropriate forum.
__________________
CGTalk Policy/Legalities
Note that as CGTalk Members, you agree to the terms and conditions of using this website.
 
Thread Closed share thread



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
CGSociety
Society of Digital Artists
www.cgsociety.org

Powered by vBulletin
Copyright 2000 - 2006,
Jelsoft Enterprises Ltd.
Minimize Ads
Forum Jump
Miscellaneous

All times are GMT. The time now is 01:47 PM.


Powered by vBulletin
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.