(or you'd get a smaller SSD and make it work - eg renting cloud storage might be an option)
At 50 MBit/s my connection to the cloud wouldn't be nearly fast enough to get comfortable access. Also no streaming (maybe some can do that?) and no downloading right into the cloud are show stoppers each.
50Mbit is faster than probably 98% of people on the internet. If you really need real-time access to these terabytes of the data, sure, cloud storage may not be for you. But if you're archiving movies / TV series / linux distros do you really need instant access to all this stuff? At 50Mbit sustained download, you can transfer 10 gigs in 26 minutes. Allowing for overhead your real world speed could reasonably be 40 minutes to download 10 GBs. Or 4 minutes for 1 GB. Doesn't sound too onerous to me.
It depends on how expensive this cloud storage is of course, but since you *do* have fast internet, you should really consider this. It gives you off-site backup, access to the data from multiple locations, it is likely only going to get cheaper over time. You don't have to pay for disks that you
should expect to die within 10 years and replace after 5. You may discover that actually you are perfectly fine with 500gb - 1 TB of local storage and you didn't really need all that extra storage after all. I know I've got several hundred gigs of TV shows stored that I
may watch again in 2-3 years time, but I am starting to get a little low on storage space, so I'll probably just end up deleting them and then if I do want to watch them in the future, re-download them or perhaps I'll have signed up to a legal TV streaming service by then so it won't matter.
If you're concerned about longevity, which you clearly are, and not so concerned about performance, which you clearly aren't , then why would you ever consider getting a single drive instead of a RAID setup?
Because I've never done it before and I'm not sure what the best way to go for it would be, or if there are downsides I'm not aware of. I'm not even sure if my mobo (or any mobo for that matter) would be all I need. So any pointers in that department would greatly help my decision. Not to forget adding a RAID controller or a RAID capable NAS could be pricey.
EDIT: Scratch that last paragraph ... partially. Apparently mobo RAIDs are a deadly sin because of shit reliability. And software RAIDs tend to be somewhat unstable as well, which defeats the whole purpose of high availability. So anyone know their way around RAID controller cards? I'm wondering how big the CPU impact of the cheaper cards actually will be. If I need to spend 200+ Euros to not be disappointed I'm probably scratching the whole idea.
Which brings me to my other idea: Any NAS systems doing a good job at price, performance and reliability?
Short summary: motherboard RAID - avoid like the plague. OS RAID (Windows): good. Hardware RAID - way overpriced for your use-case and effectively has the same downsides as motherboard RAID.
Motherboard RAID - this uses special drivers for the RAID controller on the motherboard in order to talk to your hard drives. There is no (or very little) special hardware to actually perform the RAID functions and calculations; the bulk of it is offloaded onto the CPU. But the key thing here is that your hard drives have data in them that requires a specific driver to be able to read the data from. If your motherboard gets destroyed for some reason but your hard drives are intact, this means you need to install the hard drives into another machine that has the same RAID drivers in order to read from them. Nowadays the motherboard RAID is likely to be one of a fair few standard chipsets (likely Intel or Marvell), so finding a compatible motherboard should usually not be too hard. But it is an extra step you have to deal with should you ever need to do this sort of thing, and since the motherboard RAID is not actually giving you any performance advantage, there is really no benefit in motherboard RAID. It used to be the case that Windows couldn't do RAID (ie, Windows XP) so motherboard RAID was your best choice, but that is no longer the case.
Operating system RAID - uses a standard storage driver that is part of the operating system to perform RAID functions. Naturally 100% of the work is done by your CPU, but it truly is not a significant workload; any CPU from the last 15 years will handle RAID without adding any perceptible decrease in performance in the rest of your system. Windows 7 can do (at least) RAID 0, 1, 1+0, 5 and 6, so you don't need anything fancy to get the most useful RAID levels. The key difference between this an motherboard RAID is that the standard disk drivers in the operating system can do RAID. That means you can plug your hard drives into any other computer running the same operating system, set up the RAID volume and read the data off them. One limitation of OS RAID is that if you're doing it on your system drive, you can only do RAID 1 not RAID 0 or 5; RAID 0/5 on a system drive requires motherboard RAID as that has its own separate bios and basic drivers that are loaded before the OS is loaded.
Hardware RAID - uses hardware to do all of the calculations and management of the RAID volume, meaning your system has very minimal to nil CPU overhead when dealing with the RAID. This level of CPU overhead only matters in datacenter applications with high disk load; in your home system you are very unlikely to have these access patterns. HW raid controllers are expensive and suffer a similar problem to motherboard RAID - if your controller dies, then in order to get the data off your hard drives you will need another controller of the same model and firmware revision to read the data off. This might be fine if your controller dies within a year of purchase; but if it dies after 6-7 years, it could be difficult/expensive to find the same model RAID controller again, although I guess HW RAID vendors would allow backwards compatibility between RAID controllers to help avoid this problem for their customers. HW raid controllers are where you're going to get access to the more exotic RAID types, but of course you don't need these for home use. Since they're an enterprise product, they'll tend to have fancy management tools to manage the data and partitioning and access patterns etc, but again you don't need this for a home application - which is precisely why these are enterprise features because they're supposed to be 'value-added' and enterprises will pay the premium for the extra functionality.
I have no experience with NAS, but the very name for it - network attached storage - suggests you should only consider this if having your storage on a network actually provides an advantage for you. If you want to access content from several different devices on your network, is there another way to achieve the same outcome? If you have a 'main' desktop PC that is always on (or maybe your media center is always-on), you could configure your network to simply make the hard drives on that machine shared to other devices on the network - then there's no need for a special NAS. One advantage from a NAS that home users could find useful (YMMV) is since they're external boxes that just run storage and nothing else, they are easy to hook up to small and cheap UPS. So if there is a powercut or something like that, your NAS can keep running for 30+ seconds in order to safely power down and not damage the drives / data. Personally I wouldn't find that useful. Otherwise there really isn't much in the way to recommend a NAS for the average home user; you can get fancy data backup programs off the internet and don't need to buy a NAS to get that stuff.
Here's a no-nonsense white paper I googled comparing SW to HW raid, which covers other considerations I haven't talked about above:
https://www.adaptec.com/nr/rdonlyres/14b2fd84-f7a0-4ac5-a07a-214123ea3dd6/0/4423_sw_hwraid_10.pdfPersonally I use RAID 1. Cheaper and simpler than RAID 5.
RAID 1 halfes the HDD capacity while a RAID 5 at most cuts a third, making it actually cheaper (unless the controllers are more expensive?) and is easier to expand. The added complexity of RAID 5 is what the controller is there for, right? Or are there also consequences for the user?
RAID 5 requires 3 disks. Say a disk costs $100. This means you pay $300 to get $200 worth of storage. RAID 1 requires 2 disks. This means you pay $200 to get $100 worth of storage. So yes, RAID 5 technically gives you a better efficiency for storage; but it also costs 50% more than RAID 1. Windows 7 can do RAID 5 and RAID 1, so 'controller cost' is not a consideration here.
Another consideration is that if you have 3 disks instead of 2, then you also have a 50% higher chance of a drive failing. When a disk in a RAID 5 dies, then the volume is 'degraded' and runs at reduced performance until the volume is rebuilt (a replacement drive added). If one of the remaining 2 drives dies, then you've lost all of your data anyway. You might think "how likely is it for 2 out of 3 drives to die close together?" but actually it is quite likely: if the drives are all from the same batch (likely) then any defect in production has a shared risk for the drives; if your house gets hit by lightning then all your drives could be fried together; if your computer overheats and that kills off one of the drives, then one of the remaining drives is also likely to have been damaged from the heat load and could die soon as well, etc. The rebuilding process requires all of the parity data to be re-built on the new drive; this necessarily requires many hours to complete on large drives, and induces very high read loads on the existing drives during this time - which can be enough to push a fragile disk (see previous sentence) over the edge and cause it to die. So you've gone from having 1 dead drive and a degraded RAID system, to 2 dead drives and all your data is lost anyway.
In a RAID 1 scenario, each drive can be independently read as a regular drive; if you unplug it from your system with RAID set up, and just install 1 of the drives into another system, that other system can immediately read the data without any special set up needed. In a RAID 5 situation, you would have to unplug at least 2 drives and put them into the other system, and that system would have to initialise them as a RAID set before data could be read out - not sure how long this process would take or if there would be any gotchas in it, but there is absolutely 0 special steps to take when putting a RAID 1 drive into another system. So if my house were struck by lightning for example, I'd leave my computer turned off and go out and buy a new hard drive, with the expectation that both of my drives are dead or damaged and may soon die. I would then plug the new drive in, and then plug in only one of my RAID 1 disks, and try and copy data off it - if it all goes well without failures, job done. If the first drive fails, I can then try and use the 2nd drive to copy data off. If both drives are fucked, then RAID 5 wouldn't have saved me anyway.
So in my opinion, RAID 5 doesn't offer a big enough benefit over RAID 1 to consider. There's no reason to do RAID 0 anymore - just get an SSD.
Post has been edited 9 time(s), last time on Jul 31 2015, 9:10 pm by Lanthanide.
None.