AMD vs Intel for 50TB NAS build

    • AMD vs Intel for 50TB NAS build

      Hello all,

      With AMD making a charge since Threadripper was released, I was wondering if Intel is still the preferred medium for a NAS server build these days. My usage for my NAS is as follows:
      • 4k movie streaming across gigabit lan and wireless (less so to wireless) via Orbi mesh wifi I have in the house
      • Doing home automation with HASS.IO
      • Potentially spinning up a VM (or other Dockers) for web development
      • Backups of personal computers in the house (2)
      Basically this will be my main media/streaming server. I know AMD has always lead the way with more efficient power consumption, so can someone shed some light if I should still be looking for Intel or maybe there is a more efficient AMD server-class board that would be better. I need a board with at least 10 SATA ports and ideally with IPMI for headless usage. Any assistance would be appreciated thank you!

      2 Configurations I was weighing up (Intel):

      MB: SUPERMICRO MBD-X10SRL-F Server Motherboard LGA 2011 R3
      CPU: Intel Xeon E5-1650 V3 Haswell-EP 3.5 GHz 6 x 256 KB L2 Cache 15MB L3 Cache LGA 2011-3 140W Server Processor BX80644E51650V3
      RAM: HYNIX HMA41GR7MFR4N-TF Hynix DDR4-2133 8GB1Gx4 ECCREG CL15 Samsung Chip Server Memory (x4)

      MB: GIGABYTE C246-WU4 LGA 1151 (300 Series) Intel C246 SATA 6Gb/s ATX Intel Motherboard
      CPU: Intel Xeon E-2136 Coffee Lake 3.3 GHz LGA 1151 80W BX80684E2136 Server Processor
      RAM: G.SKILL Ripjaws 4 Series 32GB (4 x 8GB) 288-Pin DDR4 SDRAM DDR4 2400 (PC4 19200) Desktop Memory Model F4-2400C15Q-32GRR

      The first configuration is more expensive but I get IPMI with it. Second configuration is cheaper, without IPMI, but the processor uses almost 50% less power. Thoughts? Other suggestions?

      The post was edited 3 times, last by aitrus00: Adding configurations I'm contemplating ().

    • The biggest advantages of Intel is that it support Hardware transcoding under linux with the integrated GPU. Plex only support AMD hardware transcoding on Windows.
      You still can buy a cheap nvidia card and use it for hardware transcoding. In that case I think AMD threadpripper/epic are just better than Intel in everything.
      Intel G4400 - Asrock H170M Pro4S - 8GB ram - Be Quiet Pure Power 11 400 CM - Nanoxia Deep Silence 4 - 2X6TB Seagate Ironwolf - 2x4TB WD RED
      OMV 4.1.26 - Kernel 4.19 - omvextrasorg 4.1.2
    • 50 Tb... wow... how do you connect these Disks? Do you own a SAS Storage Array Expander Rack?
      i think its better to start with a 5TB Array... and some Sata Disks...


      maybe you searching for something like this:

      Display Spoiler

      # megaclisas-status
      -- Controller information --
      -- ID | H/W Model | RAM | Temp | BBU | Firmware
      c0 | ServeRAID M5015 SAS/SATA Controller | 512MB | N/A | Good | FW: 12.15.0-0239


      -- Array information --
      -- ID | Type | Size | Strpsz | Flags | DskCache | Status | OS Path | CacheCade |InProgress
      c0u0 | RAID-5 | 10908G | 128 KB | RA,WB | Enabled | Optimal | /dev/sda | None |None
      Equipment: a few Computers, lot's of waste heat, little time and a Pile of work.

      When solving problems, dig at the root instead of hacking at the leaves.

      The post was edited 1 time, last by Rd65 ().

    • I have IPMI and have found it very useful.

      For data storage and network streaming pretty much any processor will work. Like Blabla mentioned, the only time it really matters is if you're transcoding. I have box with a pentium G series that can transcode almost as fast as my dual xeon box with 12 hyperthreaded cores because it has GPU acceleration. And it does it using much less power.

      My desktop machine beats them both using an Nvidia card with nvenc for encoding.
    • Rd65 wrote:

      50 Tb... wow... how do you connect these Disks? Do you own a SAS Storage Array Expander Rack?
      Pretty easy with a motherboard with 10 sata ports and 8TB hard drives. The LSI 9211-8i clones (IBM M1015, Dell Perc H700, etc) make it very easy to add 8 or 16 more sata drives. I had 32 drives (all 1 and 2 TB drives back then) on a system at one time with no expanders.
      omv 5.3.2 usul | 64 bit | 5.3 proxmox kernel | omvextrasorg 5.2.4
      omv-extras.org plugins source code and issue tracker - github

      Please read this before posting a question and this and this for docker questions.
      Please don't PM for support... Too many PMs!
    • i am happy with my new m5015 (LSI 9260-8i)... i use 7 sata disks a 2 TB. Next time i may use a LSi 9266-8i but this one was cheap and i can't use pcie3. the more important question is which disks are used. 2 or 4 TB wd red drives are ok but shingeling drives like seagates are verry bad! so its easy to get a fast and reliable 25 tb storage (8*4 tb)... but 50 tb.. hmmmm... ok may be with 2 controllers, 2x 8xpcie onboard and a huge cassis with 16 drivebays... but if you plan this... then a SAS Storage Array Expander and SAS Drives may be a better choice. and it even makes no sense to do softwareraid on 16 disks...
      Equipment: a few Computers, lot's of waste heat, little time and a Pile of work.

      When solving problems, dig at the root instead of hacking at the leaves.

      The post was edited 2 times, last by Rd65 ().

    • Rd65 wrote:

      2 or 4 TB wd red drives are ok but shingeling drives like seagates are verry bad! so its easy to get a fast and reliable 25 tb storage (8*4 tb)... but 50 tb.. hmmmm... ok may be with 2 controllers, 2x 8xpcie onboard and a huge cassis with 16 drivebays... but if you plan this... then a SAS Storage Array Expander and SAS Drives may be a better choice. and it even makes no sense to do softwareraid on 16 disks...
      WD Red Pro 10TB 7200 rpm drives are not shingled (they are pmr).
      omv 5.3.2 usul | 64 bit | 5.3 proxmox kernel | omvextrasorg 5.2.4
      omv-extras.org plugins source code and issue tracker - github

      Please read this before posting a question and this and this for docker questions.
      Please don't PM for support... Too many PMs!
    • ryecoaaron wrote:

      Rd65 wrote:

      50 Tb... wow... how do you connect these Disks? Do you own a SAS Storage Array Expander Rack?
      Pretty easy with a motherboard with 10 sata ports and 8TB hard drives. The LSI 9211-8i clones (IBM M1015, Dell Perc H700, etc) make it very easy to add 8 or 16 more sata drives. I had 32 drives (all 1 and 2 TB drives back then) on a system at one time with no expanders.
      I think many consumer ATX has 8 Sata ports. The only thing to pay attention for is for the OS. Many MB will disable two Sata ports if you connect an M2 sata SSD, so it's best to buy a cheap m2 NVME.
      Also, since we are atalking about ATX motherboard, it's easy to find cheap pci-e sata adapter with 4/6 ports.
      You would still have enough space for a cheap nvidia card for transcoding.
      Intel G4400 - Asrock H170M Pro4S - 8GB ram - Be Quiet Pure Power 11 400 CM - Nanoxia Deep Silence 4 - 2X6TB Seagate Ironwolf - 2x4TB WD RED
      OMV 4.1.26 - Kernel 4.19 - omvextrasorg 4.1.2
    • Thanks for all the comments. I'd like to go the AMD route if possible for the lighter power consumption. I'm fine to add a dedicated video card if need be. The issue I have is finding AMD boards that have 10x sata ports and IPMI. IPMI is a luxury that I suppose I can do without so not a big issue if I don't have it (unless you out there have used IPMI and it's a feature you can't live without now).


      Rd65 wrote:

      i am happy with my new m5015 (LSI 9260-8i)... i use 7 sata disks a 2 TB. Next time i may use a LSi 9266-8i but this one was cheap and i can't use pcie3. the more important question is which disks are used. 2 or 4 TB wd red drives are ok but shingeling drives like seagates are verry bad! so its easy to get a fast and reliable 25 tb storage (8*4 tb)... but 50 tb.. hmmmm... ok may be with 2 controllers, 2x 8xpcie onboard and a huge cassis with 16 drivebays... but if you plan this... then a SAS Storage Array Expander and SAS Drives may be a better choice. and it even makes no sense to do softwareraid on 16 disks...

      I am using 8TD WD Red (5400RPM) drives. I have 8 of them leaving 2 sata ports for my boot drive (if I get a board with 10x SATA on it). I don't think I have a full understanding of the recommendations here, whether to go Intel or AMD, and if the configurations I have above would work for what I am looking to do. or if I should take a totally different route with MB/CPU/RAM.
    • subzero79 wrote:

      I have my eyes on this asrock mb with ipmi for amd

      newegg.com/amp/asrock-rack-x47…cessors/p/N82E16813140023


      price has gone down a little bit since last time I checked.
      What's IPMI? Why not go for an other b450 mATX with 6 sata ports?


      I am using 8TD WD Red (5400RPM) drives. I have 8 of them leaving 2 sata ports for my boot drive (if I get a board with 10x SATA on it). I don't think I have a full understanding of the recommendations here, whether to go Intel or AMD, and if the configurations I have above would work for what I am looking to do. or if I should take a totally different route with MB/CPU/RAM.
      Why not go for an SSD NVME for the OS? Also, I don't think there are many 10 sata motheboard for consumer :( I think even 8 are a lot :( You can still consider a sata adapter like this one: 4 sata ports
      Intel G4400 - Asrock H170M Pro4S - 8GB ram - Be Quiet Pure Power 11 400 CM - Nanoxia Deep Silence 4 - 2X6TB Seagate Ironwolf - 2x4TB WD RED
      OMV 4.1.26 - Kernel 4.19 - omvextrasorg 4.1.2

      The post was edited 1 time, last by Blabla ().

    • Blabla wrote:

      What's IPMI?

      I don't think there are many 10 sata motheboard for consumer :( I think even 8 are a lot :(
      IPMI......well if you read up on it or knew about it first hand you might understand why IPMI is a highly desirable feature.

      Not sure what you really mean by consumer here. I'm a consumer and my OMV server has IPMI and 12 SATA ports.
      --
      Google is your friend and Bob's your uncle!

      RAID - Its ability to disappoint is inversely proportional to the user's understanding of it.

      ASRock Rack C2550D4I C0 Stepping - 16GB ECC - Silverstone DS380 + Silverstone DS380 DAS Box.
    • gderf wrote:

      Blabla wrote:

      What's IPMI?

      I don't think there are many 10 sata motheboard for consumer :( I think even 8 are a lot :(
      IPMI......well if you read up on it or knew about it first hand you might understand why IPMI is a highly desirable feature.
      Not sure what you really mean by consumer here. I'm a consumer and my OMV server has IPMI and 12 SATA ports.
      Ah sorry, I only knew it as DRAC (from Dell). Sadly Asus,asrock, gigabyte and MSI don't support this kind of technlogy :(
      Intel G4400 - Asrock H170M Pro4S - 8GB ram - Be Quiet Pure Power 11 400 CM - Nanoxia Deep Silence 4 - 2X6TB Seagate Ironwolf - 2x4TB WD RED
      OMV 4.1.26 - Kernel 4.19 - omvextrasorg 4.1.2
    • Not sure what you mean here but ASRock supports IPMI on many of their boards including mine.
      --
      Google is your friend and Bob's your uncle!

      RAID - Its ability to disappoint is inversely proportional to the user's understanding of it.

      ASRock Rack C2550D4I C0 Stepping - 16GB ECC - Silverstone DS380 + Silverstone DS380 DAS Box.
    • Blabla wrote:

      Sadly Asus,asrock, gigabyte and MSI don't support this kind of technlogy
      All four of those companies make boards (typically their workstation boards) with IPMI. Lots of Intel boards including laptops have MEI or RMM for remote administration too.

      I have three boards with ipmi - two supermicro and one asrock rack. I have a Dell poweredge with DRAC (dell ipmi) too. I use ILO (HP ipmi) and Lenovo's ipmi all day at work. Very nice to have.
      omv 5.3.2 usul | 64 bit | 5.3 proxmox kernel | omvextrasorg 5.2.4
      omv-extras.org plugins source code and issue tracker - github

      Please read this before posting a question and this and this for docker questions.
      Please don't PM for support... Too many PMs!
    • I think I am going to go with this:

      MB: SUPERMICRO MBD-X10SRL-F Server Motherboard LGA 2011 R3
      CPU: Intel Xeon E5-1650 V3 Haswell-EP 3.5 GHz 6 x 256 KB L2 Cache 15MB L3 Cache LGA 2011-3 140W Server Processor BX80644E51650V3
      RAM: HYNIX HMA41GR7MFR4N-TF Hynix DDR4-2133 8GB1Gx4 ECCREG CL15 Samsung Chip Server Memory (x4)

      Next question I have would be how much wattage should I target for a power supply? Can someone recommend a good one, knowing what I am putting in this monster with HDs and components?
    • The Be Quiet Pure Power 11 400 CM is one of the best low watt you can find. Don't go under 400W because every psu on the market with 350W or lower are made with an worse technology, that's why I went for the 400W and not a lower one.
      Intel G4400 - Asrock H170M Pro4S - 8GB ram - Be Quiet Pure Power 11 400 CM - Nanoxia Deep Silence 4 - 2X6TB Seagate Ironwolf - 2x4TB WD RED
      OMV 4.1.26 - Kernel 4.19 - omvextrasorg 4.1.2