-
SAN with Infiniband or 10GBE
Hi,
I’ve done a lot of reading and leaned a lot but I still want the opinion of the experts.
We’ve pre-ordered the Black Magic Cinema camera and need to expand our storage. Currently we’re using a raid 0 with 4x 2tb enterprise disks. I know.. very wrong but we need the space. Let’s hope it keeps alive for you to answer 🙂Ok, so these are my thoughts:
We’re going to shoot the RAW with the BM, so very big files and edit this on 1 pc.
And for security we can better move to a raid 5 solution with a couple of spare disks on stock.. check..But I can’t decide whether to use the low latency Infiniband or the (cheaper?) 10GBE solution with the proper 10GBE nic.
For the Infiniband solution I’m looking at Accusys, 12 bay 3tb raid5 solution
For the 10GBE solution I’m looking at the Synolygy NAS Ds3612XS 12 bay 3tb raid 5The Accusys seems to be about 10k (euro’s) and the Synolygy about 6k (euro’s)
Using the BM raw files we would need about 300 mb/s solution and I think both should work right? Will the lower latency of Infiniband be better? Or will the Synolygy be good enough in our setup?So we need 1 PC to edit from the storage and 1 pc should be able to access the files to do stuff like stabilizing with warp (AE) etc. But the editing will be done on one PC.
Please share your thoughts!
Thanks!
-
5 Replies
-
Laurens,
A 40gb infiniband solution does seem to be a bit extreme for a single editing station that you are looking to push 300 Mb/s with. I would recommend using a 10Gbe solution, being that you will be able to sustain a 300 Mb/s transfer rate with 10Gbe. When it comes to pushing data we’ve been able to push 1158 Mb/s over a 10Gbe network with our storage, with ProRes HD Video to 10 editing stations. We used an Arista switch between our storage and the editors for the network build out. The 10Gbe connection should be adequate, as long as the storage that you select can push that amount of traffic.
If you were going to move into a larger environment over time, and the demand for performance Vs. cost is justifiable, then I would see a need for infiniband. With your description of one machine directly connected to the storage array, then I would think that your need for 300 MB/s can be furnished over a 10Gbe network.
Aaron Vaughn
https://www.arcstorage.com -
Hi Aaron,
I think my post needs a bit correction, In Bob’s list the Accusys system was listed under Infiniband. But the Accusys setup uses a PCI-e 10GB connection, very similair to infiband according to the company that sells it here in the Netherlands. Still seems like Infiniband to me because it’s available in 10, 20 and 40gb/sec
– So both systems are on a 10GB connection.
– Accusys also offers an 8 bay 3tb array for 5k euro’s. So you have 21 TB in raid 5 (700 mb/sec)
– But the Synolygy Nas has a 12 bay 3tb array for approx 6k euro’s. So that’s 33 TB in raid 5 (? Mb/sec)So with this info, which system would you prefer. And do you need the switch when only using one Pc or could you use a single Utp cable? And what 10gbE system could you recommend if not the Synolygy ds3612xs?
Thanks.
-
Ahh so they are using PCIe connect over cable, so that makes some sense. PCIe over cable is a great technology and the cost is comparable to 10Gbe connects. That’s a much better option Vs. infiniband, being that you’d still need a network manager for true infiniband being that it doesn’t understand direct connect. As long as they have the technology in place that can understand that connectivity, you may have to write the code to help the communication, but if they can guarantee connectivity, you’ll see much better performance and lower latency.
Accusys has a great product that is very fast and works great with apple products, they have a great reputation for performance for video.
Synology has some decent products, but mostly geared towards a windows storage environment for unstructured data or true NAS Vs. Video performance.The Accusys box although more expensive, may be better geared toward your specific video performance requirements, but the Synology could be a good option, being that it is 10Gbe and as long as it performs to their promised transfer rates, could be better for your budget.
Price/Performance over 10Gbe Vs. Infiniband I take 10Gbe, but prefer infninband (original discussion line)
PCIe over cable will soon become more predominant in the market place, and it is a very viable solution, which provides great performance for the price.
Sorry to be vague on helping you with your decision, but promoting a competitor is not my strong suit! LOL.
Aaron Vaughn
https://www.arcstorage.com -
Hi Aaron,
Thanks for you insight in the matter! I think I’ll be sticking with the PCI-E solution because like you said the NAS seems to be for multiple people grabbing small amounts of data at the same time.
-
Accusys (Cal Digit Super Share is the same product).
Bob Zelin
Reply to this Discussion! Login or Sign Up