| new AfterBurner network -- plz critique
• | | | |
 | new AfterBurner network -- plz critique
by Henry Zektser on Jun 22, 2005 at 1:36:11 pm |
So Im getting sick of 60+ hour renders, and got approval for a render farm, albeit on a shoestring budget. I'm looking at building the network below, if anyone has any suggestions on what would make it run faster, I'd appreciate it.
Severs:
3 Dell PowerEdge servers, each with a p4 2.8 (1MB/800FSB), 512RAM, and a 73GB Ultra320 drive, two 1000baseT onboard NICs. The source footage/workspace will be copied locally to the Ultra320 drive on each node before the render so theres no network roundtrip for input.
Network:
1 managed 1000baseT switch split into two networks, each dell will be attached to both networks. One network will include my desktop (Athlon64/1GB) which will act as the manager/monitor. The other network will link to the storage for output.
Storage:
1 Dell PowerVault with 4 250GB 7.2K RPM SATA drives in a RAID 5.
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Jeff Brown on Jun 22, 2005 at 2:47:58 pm |
My opinion, FWIW, would be that you will save a bit of render time with copying footage locally, but it is a potential asset management nightmare, should your footage ever change (and it may not for the keying job). I would also recomment 1 GB RAM, but that is not based on any scientific data. I wouldn't bother with servers for the Servers, unless you can't find the FSB and proc. speed you need on a lower-end configuration. I'm not sure if a split network will help, but someone here should know.
I use a 4-machine farmette, and deal with video footage by sharing my workstation RAID over the network.
-jeff
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Henry Zektser on Jun 22, 2005 at 3:17:07 pm |
Can you give me an idea of what kind of performance I should expect on a small farm like yours?
What I mean is, my 3.0GHz/1GB RAM laptop with a USB2 drive for source and destination estimates 60hrs for the 89 minute scene im rendering right now.
With 4 boxes, each with 1GB and a 28GHz, sharing a RAID (basically your setup, give/take), how long should I expect the render to take? A straight cut in 4 works out to 15 hrs... will it be better than that? worse?
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Jeff Brown on Jun 22, 2005 at 8:43:47 pm |
Since your proc. speed is a bit slower (2.8 vs. 3.0 MHz) if I read correctly, it will be a bit longer than 15 hrs. Add in some network overhead and a better guess might be 17 hours. But, split it into 2 sessions, and that's less than 10 hours each; in other words, 2 overnight renders.
The estimation displayed in C* is only based on frames rendered. If the comp gets more complex, it will take longer. Conversely, if all the heavy effects and layers are at the start, and the middle to end only has 2 layers with no effects, it will be much faster.
-jeff
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Henry Zektser on Jun 22, 2005 at 10:28:22 pm |
You'll laugh, the whole 90 minutes is 2 layers, a .jpg background and a greenscreened shoulder-up person talking the whole time, one ultimatte node, one composite node.
I cant figure why on earth its taking this long... But I appreciate the help. Ive got 3 dual Xeon 2.8's coming, 800 FSB, should be fast as all hell:)
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by gary m. davis on Jun 22, 2005 at 11:46:03 pm |
1. if you are going single processor for render machines, i'd build them yourself and save a ton. ive built machines with 2 gigs of ram and hyperthreaded P4's for like 800 bucks. http://www.shuttle.com for some real nice/small machines that have built in networking, sound, graphics cards... just add ram, cpu and tiny hard drive. if you want dual proc, then you can still save money buidling them yorself, but those often require rack mounts. a 1U profile machine will cost a ton due to custom motherboards and everythign else. 2U machines will be WAAAY less expensive cuz they can use normal motherboards.
2. i would not copy the footage local, that almost defeats the purpose of automatic rendering. IF you do want to take the time to manually copy project resources local, then i cant recommend enuff alan's combustion archiver application (http://www.handmadedigital.com).
ps- one of my master classes at sigGraph is on network rendering and backbuner. details at http://www.discreet.com
//garyD gary m. davis // visualz.com
application training specialist
3ds max | combustion
"don't key DV!"
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Henry Zektser on Jun 23, 2005 at 11:59:08 am |
They're actually dual xeon's in a 1U enclosure -- $950 a pop with my source at dell. Life is good.
Im going to have teamed 1000baseT, so I'll probably leave the footage on the snap server, but I will check out that link -- thanks!
Im not sure if Im going to sig, gotta get the boss to sign off, but if I go, you're on my list of classes to hit..
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by gary m. davis on Jun 23, 2005 at 12:42:04 pm |
please email me offline because i'd like to get that source at dell and talk to them. im putting together ballpark numbers and configurations for my lecture at sig and this is, indeed, news to me to get gigabit, 1u, dual xeon for that cheap
//garyd@visualz.com
gary m. davis // visualz.com
application training specialist
3ds max | combustion
"don't key DV!"
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Esteban on Jun 23, 2005 at 1:06:44 pm |
$950 1U dual xeons...mmm thats a never seen before price..
Esteban
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Henry Zektser on Jun 23, 2005 at 1:32:47 pm |
Dell, catch them on their free second processor deal, and buy the PowerEdge SC1425. The free second proc gets you a box at $800+shipping, $150 for the upgrade to 1GB, and youre done.
Enjoy:)
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Jeff Brown on Jun 23, 2005 at 2:00:07 pm |
Hmm, $950 for a 1U box. Might be time to get out the charge card...
And, as a comment as to why it's taking so long: You're rendering 90 minutes of footage, dude!!! Geez, that's a whole feature. I'm used to having 1 to 4 hours renders (on the farm) for one 30-second comp [well, yeah, more than 2 layers ;>) ]. Of course, I have a short attention span: anything over a 1 minute project makes my head spin.
-jeff
| | | | |
• | | | |  | Re: new AfterBurner network -- plz critique by Henry Zektser on Jun 23, 2005 at 2:04:31 pm |
Yeah, I hear you, 60 hrs isnt unreasonable. Problem is, we have 30 of these renders to get done by end of july. At 60 hours each, Im going to be rendering till december unless i buy some more boxes.
| | | | |
| |
|