FORUMS: list search recent posts

RAID Recommendations for DaVinci Resolve

COW Forums : DaVinci Resolve

<< PREVIOUS   •   VIEW ALL   •   PRINT   •   NEXT >>
Tomas Bocking
RAID Recommendations for DaVinci Resolve
on Aug 7, 2013 at 2:39:02 pm

Hello guys, I'm building a raid for davinci (12 disks on an areca raid card) and I would like to know what would be the best setting for being the media drive for davinci.

Any recommendation on sector size, block size, filesystem (xfs? It is a linux box)

Thanks a lot!


Return to posts index

Margus Voll
Re: RAID Recommendations for DaVinci Resolve
on Aug 8, 2013 at 5:43:46 am

You should dig in to Raid forum here on Cows.

There is a lot very specific information lingering around there about that.

--

Margus

http://iconstudios.eu
https://vimeo.com/iconstudioseu/videos

DaVinci 9, OSX 10.7.4
MacPro 5.1 2x2,93 24GB
GTX 470 / Quadro 4000
Multibridge 2 Pro


Return to posts index

Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 9, 2013 at 2:39:32 pm

Thank Margus, yes I have been reading the forums, looking for information.

Wht I found on review sites is that the performace of ext4 seems better than xfs.

I KNEW that xfs was a must for video editing, has anything changed regarding ext4, is it better than xfs?

Thanks

Thomas


Return to posts index


Margus Voll
Re: RAID Recommendations for DaVinci Resolve
on Aug 10, 2013 at 6:42:42 am

I think you are going into really low level of details here

Mostly people talk about speed and raid level protection.

You should see that your array gives out speed needed for your workflow with some overhead.

--

Margus

http://iconstudios.eu
https://vimeo.com/iconstudioseu/videos

DaVinci 9, OSX 10.7.4
MacPro 5.1 2x2,93 24GB
GTX 470 / Quadro 4000
Multibridge 2 Pro


Return to posts index

Joakim Ziegler
Re: RAID Recommendations for DaVinci Resolve
on Aug 13, 2013 at 12:47:38 am

We run our Linux Resolve system on a 24-disk Areca card, with ext4. You'll probably want to get newer versions of e2fstools than the ones that are included with the standard Resolve CentOS install, since that will let you format partitions larger than 16TB. Apart from that, you will want to tune your stripe and stride parameters when you create the file system to reflect the layout of your RAID.

Doing this gives us performance in excess of 1GB/sec both read and write on a RAID6 with 24 drives, which should be plenty for most Resolve use.

--
Joakim Ziegler - Postproduction Supervisor


Return to posts index

Paul King
Re: RAID Recommendations for DaVinci Resolve
on Aug 12, 2013 at 4:40:16 am

Hi Tomas

The most recent models of Areca cards are now just LSI cards with Areca's front end.
Having said that, Areca do have an engineering level in their card BIOS, it's accessed with a difference password to the default '0000'.
In that BIOS there are extra settings relating to video performance. However a lot of these relate to the use of the card in OEM applications for video SANs.

With Davinci, you're usually only accessing one clip at a time so these extra settings wont really help. They are about stream count and read ahead performance.

With the Areca's it's best to just use the default settings and you'll get the best all round performance for a DAS workstation.
Video applications have a bit of everything in them from a usage perspective, large sequential read, random sequential read, image sequences etc, so no one setting will help.



Return to posts index


Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 13, 2013 at 5:04:52 pm

Margus, Joakim and Paul thank you so much for your help, but I keep having performance issues, very inconsistent playback framerates.

Lets see if you could identify anything I might be doing wrong:

Hardware:

Dual Xeon
Display card fx3800
GPU card: fx5800
12gb ram
Areca 1882x
11x 2TB Seagate Barracuda 7200

RAID info:
Raid level 5
Stripe 128k (this is the max it will allow)
Block size 512
Cache attribute = Write-back
Write Protection = Disabled
Tag Queuing= Enable

Steps to create the file system
Parted:
Partition table GPT
mkpart primary 0.0TB 20.0TB
create filesystem: mkfs.xfs -b size=4k -l lazy-count=1 -d su=128k -d sw=10 /dev/sdb1
Mounting: mount -o inode64 /dev/sdb1 /media/LocalMedia/

Is anyone able to identify something that might be giving me such a crappy performance?

Thanks in advance and thanks again for everyone who collaborated in this thread.

Tomas


Return to posts index

Margus Voll
Re: RAID Recommendations for DaVinci Resolve
on Aug 13, 2013 at 5:09:08 pm

Your gpu's are dated both of them.

--

Margus

http://iconstudios.eu
https://vimeo.com/iconstudioseu/videos

DaVinci 9, OSX 10.7.4
MacPro 5.1 2x2,93 24GB
GTX 470 / Quadro 4000
Multibridge 2 Pro


Return to posts index

Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 13, 2013 at 5:16:52 pm

Yes but the system was not showing these symtoms when working connected to a san.

I'm having problems now that I have put a raid card in and tryng to make it work locally.

Any insights about the raid creation process?

Thanks a lot

Thomas


Return to posts index


Joakim Ziegler
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 4:18:55 pm

I haven't used XFS in a very long time, so I can't help you that much there. I see options in your mkfs.xfs line that look like stripe width and stride, though, so you've probably got that part right.

What kind of playback performance are you getting? Have you benchmarked with bonnie++ to see what the filesystem is giving you in general?

--
Joakim Ziegler - Postproduction Supervisor


Return to posts index

Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 7:32:57 pm

I've tried both xfs and the last version of ext4 tools that would allow over 16tb volumes with pretty much the same results.

Any ideas?


Return to posts index

Margus Voll
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 8:14:05 pm

Have you measured speed and compared it with san ?

--

Margus

http://iconstudios.eu
https://vimeo.com/iconstudioseu/videos

DaVinci 9, OSX 10.7.4
MacPro 5.1 2x2,93 24GB
GTX 470 / Quadro 4000
Multibridge 2 Pro


Return to posts index


Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 8:20:03 pm

Is not giving a simple play of 1080 dpx, there is something seriously wrong with the setup, but I cant figure it out what it is.

I'm about to try software raid next, since the have to do some work and then ocntinue testing, but it driving me nuts!

Thanks for the help,

Thomas Bocking


Return to posts index

Joakim Ziegler
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 8:40:48 pm

Linux software RAID is definitely going to be slower than the Areca card, unless something's very strange. Can you run a Bonnie++ test with a test size of 3-4 times your physical memory size, and disabling cache, to see what kind of speeds you're getting? It should take maybe 15-20 minutes to run at the most.

--
Joakim Ziegler - Postproduction Supervisor


Return to posts index

Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 8:47:07 pm

I will do that, I know it should be better with the hardware raid, but Im running out of ideas and there is little left to try.

Look what areco support sent me:

"and it is normal that software raid is much faster than hardware raid. because software raid use system resource and system have much faster processor and more memory space."

I don't know if it is funny or sad. A dedicated dual-core raid card with 4gb of ram being slower than a software raid seemed wrong hehehe.


Return to posts index


Joakim Ziegler
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 8:52:59 pm

For what it's worth, they're wrong. Hardware RAID on these kinds of cards is far faster than software RAID.

--
Joakim Ziegler - Postproduction Supervisor


Return to posts index

Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 14, 2013 at 11:13:22 pm

Here is the bonnie result

Nas@davincinas bonnie++-1.97.1]$ ./bonnie++ -d /media/237c8e42-381d-48ac-bde7-49991a35bfd6/ -c 8 -r 16000 -n 100
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.97 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 8 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
davincinas 32000M 374 98 42914 7 18793 6 3428 91 271023 36 564.8 42
Latency 22219us 3126ms 694ms 36794us 68341us 91289us
Version 1.97 ------Sequential Create------ --------Random Create--------
davincinas -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
100 13149 72 +++++ +++ 2827 3 11350 59 +++++ +++ 1968 2
Latency 422ms 766us 2925ms 656ms 19us 3881ms
1.97,1.97,davincinas,8,1376513702,32000M,,374,98,42914,7,18793,6,3428,91,271023,36,564.8,42,100,,,,,13149,72,+++++,+++,2827,3,11350,59,+++++,+++,1968,2,22219us,3126ms,694ms,36794us,68341us,91289us,422ms,766us,2925ms,656ms,19us,3881ms


Return to posts index

Joakim Ziegler
Re: RAID Recommendations for DaVinci Resolve
on Aug 15, 2013 at 12:31:10 am

There's definitely something wrong there. It's giving you 42 MB/sec writes and 271 MB/sec reads. First of all, those numbers should be more similar, and secondly, they should be far higher.

What does the Areca admin console say? Is the array finished initializing? Is it in a normal state? If it's not finished initializing, what's the priority of the background task?

--
Joakim Ziegler - Postproduction Supervisor


Return to posts index


Tomas Bocking
Re: RAID Recommendations for DaVinci Resolve
on Aug 15, 2013 at 12:59:27 am

Finished, operational, everything done.

I leaning either a bad ram stick on the card or a faulty card altogether.

It sucks really bad, because I bought this in the States but Im now in argentina. So I need to take it to the importer to send it back, so it might take some time, but is so frustrating.

Thanks for all your help I greatly appreciated.

Thomas


Return to posts index

Joakim Ziegler
Re: RAID Recommendations for DaVinci Resolve
on Aug 15, 2013 at 4:37:27 am

Yeah, that sucks. One bad thing about Areca also is that their warranty replacement service is very slow. We're in Mexico and our supplier got ours from the US, but it had to be sent to Taiwan for replacement, it took a very long time, and we ended up just buying another identical card in the meantime.

I hope you get your problems resolved, best of luck.

--
Joakim Ziegler - Postproduction Supervisor


Return to posts index

<< PREVIOUS   •   VIEW ALL   •   PRINT   •   NEXT >>
© 2017 CreativeCOW.net All Rights Reserved
[TOP]