« Wasting Away + Looks = Winning Film | Main | Spring Cleaning = New location »

October 06, 2008

TrackBack

TrackBack URL for this entry:
http://www.typepad.com/services/trackback/6a00e54fa2d67788340105355a6d2b970b

Listed below are links to weblogs that reference Super Fast 4TB RAID for Under $1,500 (was $2k):

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Doug Daulton

John - Great article. I wish it was out there before I bought my Sonnet Raid. I definitely took one in the wallet on the price-to-performance ratio with that purchase. Does ProAvio make a 1U or 2U rackmount form factor of this box? - Doug

[Ed. Note: PROAvio makes rackmount systems, but I've never used them and can't vouch for their goodness.]

Patrick Wilson

John,

Thanks for the review and tips. I'm just getting ready to rebuild my MacPro and set up a raid or drobo. Still debating which way to go. If I had the money I do both;) What are your thoughts on mixing brands of 500GB drives, say some Maxtors with some WDs both at 7200 RPM, bad idea??

Thanks for the Media Show and keep up the good work on TWIM.

[Ed. Notes:

I'd suggest either RAID 5 or RAID 10 or getting BOTH the Drobo and the RAID system I've outlined. RAID 0 has no redundancy and 4TB is a lot to back up.

I, personally, wouldn't mix drives unless you already have them laying around. New WD drives are $65 each, which is pretty cheap.

Thanks for the kind words about the shows!]

Jonas Hummelstrand

Thanks for sharing!
Is it noisy?

[Ed. Note: PROAvio has some "quiet technology" that makes the system very noiseless, but adding quiet drives helps a lot.]

CareyD

Hey John, looks like a fine build there. Nice job. As a career video editor/motion graphics designer and hardware geek, I've built my own (and for colleagues) RAID solutions for about 10+ years and have almost always been very happy with the results.

In your opening, you mentioned something:
#3 Do It Yourself RAID systems suck. And, not just kind of. They are unreliable. They are flimsy and half-baked and, if you're really cheap, they use an inferior RAID card or a software RAID.

This is a little troubling, since you then go about and build a do-it-yourself RAID that 'doesn't suck'. So, additional clarification is needed for what you mean by that statement.

[Ed. Note - This RAID isn't a "Do It Yourself" in the traditional sense, it's more of a mash-up where known parts are put together, exactly as the manufacturer would, but for a hell-of-a-lot less money]

How is the noise level on the completed box?

[Ed. Note: The RAID is quiet. Very quiet. Like 30 dB quiet. On the floor, I can't even hear it. The same can't be said for the G-TECH G-RAID sitting 10 inches away from the custom RAID]

Also, I would encourage a little pragmatism on RAID, having been all over the 'spectrum', and that is the "horses for courses" argument. Meaning, the right RAID for the type of work you are doing. Always allow healthy extra margin for both capacity and bandwidth, but for many folks, a 200MB/sec RAID is more than enough. Also, sometimes software RAID is 'just fine'. I have examples of both software and hardware (Highpoint) RAID running in my shop.

[Ed. Note: I disagree. Software RAID is unreliable and uses overhead of the Operating System. 200 MB/s is not enough for HD in my opinion.]

I'm totally with you on the RAID 0 vs. 5 argument for local video storage. RAID 5 is not a panacea and I deem it a bad thing if it causes people to be lazy/false sense of security about keeping proper, separate, distinct backups. I too use RAID 0 locally but always have separate, standalone backups both nearby and off-site. More copies of stuff, in more places, beats parity and redundancy RAID schemes EVERY SINGLE TIME when the sh*t hits the fan. And it will.

[Ed. Note: I believe, strongly, that RAID is where the video goes and the backups go somewhere else. Although, if you wanted to be "safe" during use, this system in RAID 5 is both redundant and seriously faster than 200 MB/s (your benchmark above).]

On costs:
(I'm treading carefully below because I have numerous friends in the storage sales/solution part of the industry, but as an end-user myself and an advocate for users everywhere, I must speak the truth:)

The video storage industry has historically always made really huge margins on RAID storage solutions. Big commissions and 'salesmen' to go with them abound.

I believe the salesmen's single largest leverage to getting these high-margin sales is the 'fear factor'. You know, where technophobic creatives want someone to 'just tell them what to buy' and these users place an inordinate amount of faith in their expensive solutions provider that somehow 'expensive' means 'safer'. This is true on a customer service level, to a point.

[Ed. Note: That is unbelievably insightful and diplomatic. Thank you for saying it.]

But what the user really needs to do is educate themselves on the fundamentals of RAID and realize it really isn't all that complicated or scary. Your post goes a long way towards that. Kudos!

[Ed. Note: Thank you for reading and providing such a thoughtful, well-constructed and considerate response. I (and I'm sure my readers) appreciate it.]

Scott Simmons

Great piece John. I'll say it before Stu does .... muy rebel!

rejeanff

GREAT article! I always had the feeling the "off the shelf" solutions were price-inflated and not as fast as their manufacturers would have us believe. Thanks very much.

Shane Ross

NICE...LOVE to see the cheaper options out there, since many people cannot afford the bigger guys. The bigger guys (Caldigit) offer things that this raid cannot...higher SUSTAINED throughput. Look at your graphs.,.notice how the HD Pro has a very steady range. Your unit has areas where it peaks and DIPS very low...that might cause playback to halt when working with large formats like uncompressed HD 4:2:2 or 4:4:4. Fast, but with issues. The technology that CalDigit offers (I'll try not to sound like I am in the pocket of CalDigit) makes sure that no dipping like that occurs. THAT is what you are paying the extra for. Many people would pay that extra.

Personally, the dipping wouldn't affect many people out there, but if you are working with large formats, it might. But I still like to see these cheap options available out there. I myself build a 5 drive RAID 0 using a computer case and 5 Hitachi drives. So I'm hip.

[Ed. Note: I'd like to agree with you, but CalDigit's benchmark is not accurate. They've edited out the spikes in their graph... the CalDigit card spikes, just like every other RAID card.]

Dan Rubottom

Excellent article John!
This is exactly the type of info I've been researching myself. Drobo is good, but would like more performance like this solution.
Thanks

Brian Potter

Exceptional post! Thanks for the info!

Chris

Awesome Stuff! Thanks for your leg work.
Could you recommend a PCI-X (133) solution as my Avid system is not PCIe compatible?
Best,
-C

[Ed. Note: I'm looking into other options, including the CalDigit, as I've been called out by them about some of the benchmarks and want to test their card. My understanding is the RocketRAID 2224 is a great PCI-X card, but I believe it only has one connection for the RAID. Someone else might better know the answer to this question, as I'm not a PCI-X expert.]

Julik

This is wonderful! thanks a bunch for your research. I'm curious how much that will run in Europe, with all the import taxes and VAT and stuff...

Brandon Thomas

Anyway to make this into a SAN or integrate it with an existing SAN system?

Don V. Stephens III

Hey John,

Great post - I saw it via a link at RedUser. There's a great article from Bob Zelin about turning the CalDigit HDPro into a "poor man's Avid Unity" shared storage - I bet it would work with your config as well. (Not for 2K, however: only uncompressed SD, and ProRes422HQ and DVCProHD across the network.)

Here's the link:
http://forums.creativecow.net/thread/228/374

A dedicated MacPro is required, as are some additional pieces of gear. Here's the cost breakdown, in addition to the parts you already listed:

MacPro - refurbs generally available at $1999, or new at $2800
SmallTree managed ethernet switch - $1713
SmallTree 4-port GigE card - $669
MetaLAN Server - $549
MetaLAN Client - $395 per client machine - assume 4 @ $1580

So for another $6510 you've made the whole thing into shared storage for 4 suites.

--Don

Don V. Stephens III

Hey John,

Great post - I saw it via a link at RedUser. There's a great article from Bob Zelin about turning the CalDigit HDPro into a "poor man's Avid Unity" shared storage - I bet it would work with your config as well. (Not for 2K, however: only uncompressed SD, and ProRes422HQ and DVCProHD across the network.)

Here's the link:
http://forums.creativecow.net/thread/228/374

A dedicated MacPro is required, as are some additional pieces of gear. Here's the cost breakdown, in addition to the parts you already listed:

MacPro - refurbs generally available at $1999, or new at $2800
SmallTree managed ethernet switch - $1713
SmallTree 4-port GigE card - $669
MetaLAN Server - $549
MetaLAN Client - $395 per client machine - assume 4 @ $1580

So for another $6510 you've made the whole thing into shared storage for 4 suites.

--Don

[Ed. Note: Great link and info and it answers other questions about shared RAID. Thanks so much, Don!]

Jonas Hummelstrand

I've found the four-disk equivalent EditBox 4MS without disks at B&H Photo (they also have the EditBox 8MS):
http://www.bhphotovideo.com/bnh/controller/home?O=workaround.jsp&A=details&Q=&sku=575760&is=REG

However, Amazon.com won't ship the disks and controller over-seas, so that's a bummer.

I also imagine I could get a simpler RAID card if I'm only doing four disks, right? Any thoughts?

John Mark

Hey it would be nice if you can review portable raid drives or if there's such DIY?

thanks!

[Ed. Note: Great idea. I've been thinking about a portable RAID solution that's better than Firewire 800 for a while. I'm also thinking about another system for video work. I'll post more when I have more to say.]

Harry Cack

I have seen that Proavio now offers Hardware RAID card support as well. The HighPoint RR3522 and Areca 1221x are both Hardware RAID cards that support Mac & PC HD editing and offer great performance according to most of the reviews I have read online. I think this will be my next RAID.

http://www.amug.org/amugweb/html/amug/reviews/articles/highpoint/3522/

http://www.amug.org/amug-web/html/amug/reviews/articles/areca/1221x/

[Ed. Note: I've never tested the cards you mention, but I am certain the card I'm using is a combination of hardware and software RAID (and software on the computer to help configure the card). I think I'll pick up a 3522 and test it alongside the CalDigit I'm getting.]

Peter Majtan

Hi Jon, good work, but You have been misinformed about few things. Have a look here:

http://www.scarletuser.com/showthread.php?t=1296

Take care..

Peter

[Ed. Note: Nothing in the link above causes me to rethink anything I've written.

In your post, you talk about using 4 drives for about the same as my 8 drive system and reference an 8 drive RAID which is considerably more expensive.

There are no benchmarks or any hard evidence in your article to validate your comment above or invalidate anything I've said in my post.

Put another way, calling me out as misinformed is not the same as me being misinformed. And, while I respect your opinion, it is just that, an opinion. I took the time to perform a large number of benchmarks, ignoring most of what vendors say about their products, which - I believe - is what people want to know.

Like you, I have nothing to gain from writing this article, I'm just trying to help people make an informed decision when purchasing a RAID, which is usually a complex and difficult decision because there are not enough facts around cards, drives and systems. ]

Peter Majtan

[Ed. Note: This point is argued even more at http://www.scarletuser.com/showthread.php?t=1296 -- so, feel free to read more of Peter's comments there.]

Hi Jon - I meant no disrespect and I am sorry if it came out like that. But here You go:

"In your post, you talk about using 4 drives for about the same as my 8 drive system and reference an 8 drive RAID which is considerably more expensive."

This is not necessarily so - if You adjust Your own calculations with the cost of the 8x $200 1TB drives You will get:

$550 - Edit Box 8ML
$ 75 - 2x InfiniBand to MiniSAS cables
$275 - RocketRaid 2322
$1600 - 8x Wester Digital 1TB Drives
------
$2,500  (without tax or shipping)

Which is only $173,- USD less then the one I have posted. If You also account for the 4x 250GB drives I have left over from the HD Element - this negates to "0" - so definitely NOT "considerably more expensive"...

Also You have mentioned that "each drive is theoretically capable of 3Gb/s" which in fact is true (and I have confirmed this in my post), but given the context it is little misleading. For anyone considering average SATA HDD's which are normally capable to sustain about 75MB/s (some really good ones can handle 100MB/s) - You will need to connect more then 4 drives to reach the limit of eSATA. Again - to Your credit - You did mention this in relation with 8-drive setup and yes - eSATA will limit the drive's bandwidth. But You have "automatically" discounted eSATA as a viable RAID option for DIY folks out there. Many could find 4-drive RAID satisfactory with todays capacities of single drives exceeding 1TB...

And NO - fiber is definitely not the way to go forward for DIY RAID system. Not unless You have really deep pockets. Now I can't seem to find Your recommendation about using fiber...

Lastly You have said:

"Other, cheap RAID solutions involve software RAID. This is bad, slow and devours your operating system at higher bandwidth use. Ignore software RAID if you want the highest quality, speed and reliability."

When in fact the RocketRAID You are using is SW/HW hybrid - and I did use this system myself, so I do know what I am talking about. Feel free to contact RocketRAID for clarification...

In any case - I think You did make a substantial effort to make this post and kudos to You for sharing it with others. I just think than maybe more careful use of words and sentencing could leave more room for alternatives.

Peace

Peter

Phil Galaura

Just want to chime in and say thank you for helping me make a decision on making a purchase. It's on it's way as I type. Your research into it along with the facts helped me go for it. Thanks again from an indie editor.

[Ed. Note: Awesome! E-mail or post a comment and tell me how it works out. Mine's humming along at a great speed, even at 70% full.]

Gregory

This looks like a purely hardware based card for under $600 - PROAVIO HighPoint RocketRAID 3522 Host Adapter. Can you confirm if this will work just as well or better?

Thanks

Greg

[Ed. Note: I haven't personally tested the RocketRAID 3522 (yet), but I have one on order. My guess is, like the CalDigit RAID card, it will work very well. I'll post more when I've tested both cards.]

L Stephens

Hi

So i got my setup up and running!

Thx for the info :)

OK had a few problems to get where i am now... U neglected to really go into the whole initalize devices thing in High Point which after a while of fiddling worked out for myself.

[Ed. Note: Sorry about that, it's pretty simple, but you have to initialize ALL drives for RAID 0. There's a painful moment where you're not sure if you've selected all drives. What's your free space?]

I'm pretty much a newbie at this Is there anyway u can be a bit more precise with exactly what u did?

I made a partition with the RAID (just like in your screen snap) in Disk Utility and my High Point browser display looks exactly like yours.

I installed the AJA Control Panel but the best speeds i'm seeing is
Write: 168.4MB/s
Read: 199.1MB/s

Any ideas where i have gone wrong? I should be double that for both right?

MAcPro 2 2 GHz DualCore Intel Xeon
6GB 667 MHz RAM
4TB RAID (8 x 500GB drives etc)

[Ed. Note: You should be seeing speeds in excess of 300 MB/s at least, depending on your setup. Are you configured for RAID 0, it doesn't sound like it. Also -- try using the AJA Speedtest at the rates I've shared. Also, you're using BOTH fiber connections, right? Feel free to e-mail me and we'll resolve this. Something's wrong.]

L Stephens

Problem was I had the RAID card in the 2nd slot works perfect in the top slot.

Brandon Thomas

seems that the editbox 8ML has been replaced with the Editbox 8MS.. any insight if the 8MS will be acceptable substitution?

it seems that it is using miniSAS to miniSAS instead of the infiniband connection of the previous box...

is there a downside that makes tracking down an EB8ML a better decision?

Ed. Note: I'm planning a RAID Part I & will try to address this issue at that time. I like miniSAS tho.]

Jason Bedogne

I read your article about the RAID set and it sounds perfect for our applications (Editing on a MacPro with FCP, Logic, AE).

I have done some additional reading and the only issue I see is with the Rocket Raid card, not being a true Hardware card.

I came across the CalDigit RAID Card (http://www.bhphotovideo.com/c/product/574875-REG/CalDigit_760600_RAID_Card.html) and everyone I read has nothing but good things to say about it. It is more expensive, but I’m willing to shell out the extra coin.

Do you see any issues with using this Card and your enclosure and cables?

I will be running a RAID 5 set.

The comments to this entry are closed.