Creating a 48tb Network Storage Server

Discussion in 'Computer Audiophile: Software, Configs, Tools' started by Lou Casadonte, Feb 3, 2020.

  1. Lou Casadonte

    Lou Casadonte Friend

    Pyrate
    Joined:
    Jul 2, 2017
    Likes Received:
    199
    Trophy Points:
    43
    Location:
    usa
    https://i.imgur.com/aONHMcu.jpg

    I thought I would share my current project which is audio and video driven. I am putting together a server which could run any audio/video backbone and store the data. A quick summary of the parts and cost would be as follows:

    SUPERMICRO X9DRi-F mb w/2 intel xeon cpu's 190
    64g ram 104
    Rosewill case 110
    12 4tb wd red at 90 per
    2 adaptec asr71605 70/per card
    1000w corsair ps 200
    2 1tb samsung evo ssd's 88/per ssd
    misc cables, wires connectors, ssd case $40
    extra gpu nobrand $50

    Grand Total $2000. So far.

    I've got the 2 raid cards with 6 drives each formatted for raid level 6. I have wound up with 28tb of usable space and have set the server up to be a hyper v server under windows 2016. I have an msdn license and wanted to play int he ms server eco system from a learning/professional side of things (I do a lot with Microsoft good or bad).

    I've got 2 sans digital nas drives that will handle daily access. They are 18tb each raid level 5. One is remote.

    A couple of questions:

    1) I'm having trouble with some heat in the case and am planning on trying out some cpu coolers this weekend and may upgrade the fans in the case. Any other suggestions?

    2) Since I'm using windows server backup software licensing is expensive. I'm thinking of spinning up a hyper v vm to run just backup software to get around the server costs. What software are you guys using to keep your stuff in sync?

    Thanks,
     
  2. Greg121986

    Greg121986 Almost "Made"

    Contributor
    Joined:
    Nov 15, 2016
    Likes Received:
    394
    Trophy Points:
    63
    Location:
    Grand Rapids, MI
    If Windows is part of your professional development for work purposes, you should stay with it but there are a lot of benefits to running a Linux system. I've got a Debian system at home with 6x8TB drives running ZFS, a 1TB "dump" SSD, and NVME for OS and containers. You could use rsync to backup your files to anywhere offsite if you are running appropriate encryption which ZFS supports without any performance issues. It looks like there is an rsync for Windows as well but, it appears that it's just all commercial software that is doing the same thing rsync does. I use my server for video storage as well where I access the files using an Nvidia Shield TV.

    I just discovered a piece of hardware that has truly changed my life when it comes to playing music from my server when I realized that fiber optic USB cables are a thing. I bought one from Corning and one from Monoprice. I am currently using the Corning one with superb results. The Monoprice cable requires supplemental power which I have not tried yet because the Corning is working perfectly so far. I am beyond elated with this discovery and I plan to post more details about it soon.

    All fancy USB streaming devices are running some sort of Linux and MPD as their playback system. If there is one that doesn't, I haven't seen it. I've been trying for years to find one that is reliable but all have proven to be clunky and plagued with issues. The discovery of this fiber optic USB cable has entirely eliminated the need for me to rely on these commercial products. MPD runs on my server where I have all of my files so indexing and playback is as fast as it can possibly be. Performance is exceptional. I can keep it updated and be in full control of the system. I don't know if there is equivalent playback software for Windows, but if you could use your server as a playback system, it could bring additional value to your project. Maybe Roon is the only option?

    In terms of your heat issues, I am first going to assume that you cleaned up those cables so that they won't restrict airflow. :) Your best bet is going to be high CFM fans since it looks like that case relies on negative air pressure to keep air flowing. That basically means it's going to get noisy.
     
    Last edited: Feb 8, 2020
  3. dasman66

    dasman66 Self proclaimed lazy ass - friend

    Pyrate Contributor
    Joined:
    Mar 13, 2018
    Likes Received:
    2,462
    Trophy Points:
    113
    Location:
    NW Pennsylvania
    I hate to say it but that setup looks like it is begging for heat related problems. Packed full of drives in the front, no obvious intake fans, and with what looks like only the PSU and (2) ?80mm? exhaust fans... its hard to imagine that you'll be able to get temps in check. The case just doesn't appear to give you many options for adding additional intake/exhaust fans (I'd probably want 2-3 120-140mm front and back as push/pull intake/exhaust).

    I'd also be curious as to the power draw when up and running... I imagine your electric bill will notice that box running.

    While I don't know what software/user requirements is driving your decision making process, most people these days are running NAS with a small headless computer (eg., Intel NUC) for the software (ie., Plex, Roon Server, etc). For example:
    • Synology DS418 ($370)
    • (4) 8GB WD Red (stripped from BestBuy Easystore $139/ea)
    • Intel i5 NUC ($600)
    I'm running a setup similar to the above, only I added a 2nd NAS in a remote location serving backup duties. I stopped using traditional servers years ago to reduce management headaches and to reduce cost (both equipment and operating).
     
  4. Lou Casadonte

    Lou Casadonte Friend

    Pyrate
    Joined:
    Jul 2, 2017
    Likes Received:
    199
    Trophy Points:
    43
    Location:
    usa
    Its just the pic. The drive cage is a new design by rosewill of 3 cages of 4 drives each. Each has a fan + 2 molex adapters and they are hotswappable. The case comes with 5 under powered fans. I'm leaving the 3 i mentioned but will replace the 2 80mm exhaust fans in the back of the case. I added 2 cpu coolers which solved the majority of my heat problems. I am using windows for professional reasons. My other 2 nas which will be used daily are zfs. I could have used larger drives but wanted to fill the cabinet and wanted to be able to mirror one of those other nas'. I think I will add a das in the future and start to build that out using software arrays vs the hardware array of the base. I am also running vm's through Hyper-V (one of the learning things). I am adding another 64g ram and a 2tb ssd to support those. I set up and moved my video library management function to a vm and it is working well. I 'll move home automation and a cloud server to vm's to begin with as well. I don't know power draw but estimated 700-800 watts usage at the beginning. Roon will stay on my nuc as well. The nas will be the ultimate backup for my audio/video (currently 14tb) and my personal data (currently 4tb).
     
    Last edited: Feb 10, 2020
  5. Lou Casadonte

    Lou Casadonte Friend

    Pyrate
    Joined:
    Jul 2, 2017
    Likes Received:
    199
    Trophy Points:
    43
    Location:
    usa
    I've got one of these on my radar for my qutest/mscaler https://audiowise-canada.myshopify.com/products/dx-optical-isolation-kit .
     
  6. Lou Casadonte

    Lou Casadonte Friend

    Pyrate
    Joined:
    Jul 2, 2017
    Likes Received:
    199
    Trophy Points:
    43
    Location:
    usa
    Have you hit the aac audio issue on the shield? Apparently live channels won't decode all audio formats. I'm using windows because there are things I want to learn to support my professional consulting career. Rsync on windows is what you said. I settled on bvckup2 in windows for now. Windows sucks as a playback platform. The nas will only be doing data backups and a couple of vm's to manage my libraries and do cloud computing. I'll probably move my home automation software to the platform as well. My old server will be updated to windows 10 and it runs emby (+ all the other stuff but I am just going to leave emby on this after the upgrades).
     

Share This Page