Creative Communities of the World Forums

The peer to peer support community for media production professionals.

Activity Forums Storage & Archiving RAID performance measuring – small files

  • RAID performance measuring – small files

    Posted by Antoine Durr on March 22, 2011 at 9:41 am

    Hi,

    Is there a tool similar to AJA’s diskwhacktest that is better at measuring small file sizes? The disk performance testing seems to favor files over 512KB, very quickly going into multi-gigabyte file sizes, of which, frankly, I have very few. I’d like to test the performance of my RAID setup with files smaller than that (it’s going to act as a NAS).

    A bit of background: I’m in the process of adding storage to my small (5 Mac Pro) network. Just bought a Sans Digital TR8X-B, which comes with a RocketRaid 2722 card. The downside of the RR2722 is that it only supports RAID5, but with the long rebuild times (41 hours for 8 1.5TB drives), the requirement is really RAID6. To that end, I ran the AJA test suite, and then switched to an ATTO R680 card that I bought (ostensibly for another purpose).

    Both cards run roughly at the same speed at the limit. That is, large files get throughputs in the 600 MB/sec write and 700 MB/sec read range. RAID6 on the R680 is about as fast as RAID5 on the RR2722. But… it’s at the other end that things get interesting.

    Doing a AJA file size sweep on the RR2722 showed pretty poor performance on first point or two of the graph (sub 100MB/sec). The R680, on the other hand, smoked the RR2722 on the small file size end. I’m guessing the R680 takes advantage of burst speeds on the drives to go beyond the 100-120 MB/sec/drive, closer to the 200 MB/sec burst ratings. Thus I saw numbers over 1000MB/sec for 128k file sizes on the R680.

    So that is the area I want to better explore. There were some odd dips in the graph that I want to further explore, and as I mentioned, by quantity, more of my files are under 2 MB, though by size, more are 30MB.

    Thanks!

    — Antoine

    Bob Zelin replied 15 years, 2 months ago 2 Members · 1 Reply
  • 1 Reply

We use anonymous cookies to give you the best experience we can.
Our Privacy policy | GDPR Policy