I want to build a new and more powerful server running at around 3W

  • After making my first system based on J5040 running 9W idle, I discovered that there is a way to make an even more powerful server, that is running at around 3W idle. This is not strictly necessary for me, but just a fun project, but lower power consumption will help me to use less battery power from my semi-off-grid solar system. Anyways, I want to give my son a stationary computer, specifically not for gaming, so he will inherit the previous server, if I’m successful with this new build :)


    SBC


    Like many people here probably know that the RockChip RK3588 CPU is a bit of a beast in the SBC arena, manufactured on an 8nm process node, while the big.LITTLE architechture ensures it can run at very little power in idle. As it’s probably the only SBC CPU produced on this scale, there probably aren’t many others that can compete with it in performance/watt.


    I think that the improved performance and the more cores, will help me to utilize the virtual machines more seriously, without disturbing the running docker containers.


    After evaluating various boards with both RK3588 and RK3588S, I decided on the Orange Pi 5 Plus. This is specifically because it has a full length M.2 slot, where I can install a card with 5 SATA ports. It has a mounting screw by default, which some boards don’t. It has two Ethernet ports, which may come in handy. For some reason it seems faster at video playback than the Rock Pi model 5B, which has the exact same processor.


    I ended up choosing the 16GB model, because it was only USD $6 more than the 8 GB model and it would help me to allocate sufficient memory to the virtual machines. I don’t know exactly how that’s going to affect the energy consumption, but it is going to add a bit.


    The Orange Pi 5 Plus has the RK3588 processor, which has 4/5 PCIe lanes, which enables much faster transfer speeds than the RK3588S that only has 1 PCIe lane. I will not utilize all the lanes in this build, because of a choice I had to make. When looking through the options for an M.2 to SATA port adapter, I saw that most of them have very thin PCB’s (boards) and are very flexible and some report random disconnection issues, which are two things that could be related. The only ones that were more solid because of the heat sink, were not able to use the full potential of the M.2 port. So, for now I went for the safer option and went for the Vance M.2 PCIe Gen3x2 B+M key. The speed is a matter of the “keys” on these ports, which decides what forms of transfer can be made, the Orange Pi 5 Plus has the M key that supports 4 lanes and the adapter I chose has the M+B key, which fits both in to M key slots and B key slots, but can’t fully utilize the M key slot.


    One further consideration for me living in Uruguay is that I can only order for 200 USD from outside Uruguay, up to three times a year. I was so lucky that the Orange Pi 5 Plus + the Vance M.2 adapter landed exactly below 200 USD.


    I’m curious to see how this system handles virtualization, if it will do it as well as the J5040 or if there will be issues.


    I’ve been through a lot more considerations and have skipped various less elegant solutions, that I’ll spare you the details of.


    HARDDRIVES


    Naturally I’ll be using SSD’s for a low power build, but all SSD’s are not the same. The transfer speed is not crucial in this build, as the limitation will most likely be in the M.2 SATA controller, as it’s probably not going to have more than 600 mb/s capacity and I do not have any applications where I would really need that kind of speed. So, I’m going to be more focused on power consumption and it seems like Samsung EVO 870 is a good choice:



    I was almost able to buy a 4TB Samsung EVO 870 from Amazon for 169.99 USD, until I clicked the link and they as they do so often pushed the price up to 212.5 USD when it was in the basket, which means that I can’t buy it here in Uruguay. So, I’m probably going to end up with 2TB Samsung EVO 870. I also have an old Samsung EVO that I could use for boot drive, if possible. I might also add 2x1TB PNY SSD drives later and see how they affect the power consumption.


    One thing I don’t know, that is if I’m going to be able to boot from an SSD or I’ll have to boot from the SD card. It’s possible with a single drive in the M.2 slot, but I have no idea how it will behave with the 4 port controller. Two issues I see if I can’t boot from an SSD is that both the cache and the docker containers resides on the boot drive by default and the SD card isn’t very fast, but at least I should be able to configure the docker containers to install elsewhere.


    POWER


    The power question is difficult, the bigger the power supply, the less efficient it will be at low power consumption, on the other hand, you don’t want it too small. My experience from my first build is that when I push the system to the max by starting 14 containers, I get to 25W and I expect the system I’m building to be much more power efficient.


    I would like the power supply to be somewhat efficient at around 2-3 watts, as that’s where I hope the idle power of the system to land. You can find power supplies that are about 70% efficient at 10% load, so if we have a 20W power supply, we would have that efficiency at around 2 watts.


    I have to consider that if I make the power budget very tight, then I’ll have to consider upgrading the power supply later, if I decide to expand with more drives.


    Looking at the idle and max power draw of the components considered.







    Idle W




    Max W




    Samsung EVO 870




    0.03




    2.58




    Samsung EVO 870




    0.03




    2.58




    Sata controller (estimate)




    0.2




    5




    Orange Pi 5 Plus




    2




    12 (8)




    Total




    2.26




    22.16







    At the wall, we will probably be a bit above 3W I don’t expect to ever get above 20W and I would expect that there is a small buffer for short spikes above 20W. What I’ve seen when looking around is that the Orange Pi 5 Plus uses around 8 watt when pushed hard.


    All in all, I think it’s safe to use a 20W adapter for the chosen components and the idle consumption will depend very much on the efficiency of the adapter at about 10% load. At first, I’ll give the adapter included with the Orange Pi 5 Plus a chance and that one is exactly rated at 20 watts.


    I toyed with the idea about drawing 5V out of the ATX plug from a pico power supply for the Orange Pi 5 and then just add some splitter cables for the SATA power connectors. Then I noticed that the SATA power connectors in the pico supply that I was looking at only had 5V (red) and 12V (yellow) cables, no 3.3V (orange) cables, so then I immediately started analyzing what power an SSD’s really need and it appears that in general 2.5” SSD’s only use 5V! Which means that the whole thing should be able to be powered straight off a 5V power supply.


    So, my plan is to connect the power like this:




    This means:

    • Cutting off the plug with 5 cm cable on it from the supplied 20W power supply to the Orange Pi 5 Plus.
    • Remove the insulation from where the cable was cut (both the plug and the supply cable).
    • Solder the strip of SATA power plugs and the power plug for the Orange Pi, onto the cable of the power supply (red to positive and black to negative, as the Orange Pi have negative ground). This could also be done with a terminal block.
    • Insulate the wires.


    Looking forward to your comments :)

    • Official Post

    If anybody has a diagram with measures or something like it of the Orange Pi 5 Plus, I would be very interested.

    The bottom of this page says it is 100mm x 75mm - http://www.orangepi.org/html/h…ils/Orange-Pi-5-plus.html

    omv 8.1.1-1 synchrony | 6.17 proxmox kernel

    plugins :: omvextrasorg 8.0.2 | kvm 8.0.7 | compose 8.1.5 | cterm 8.0 | borgbackup 8.1.7 | cputemp 8.0 | mergerfs 8.0 | scripts 8.0.1 | writecache 8.1.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Official Post

    Yes, I saw that, but I wanted to know about the placement of the mounting holes and ports, I can estimate it, but I would like to have some precise measures, so I can make a small cabinet for it. As I live in Uruguay, it usually takes a month to get stuff.

    You could email their support for a cad drawing/pdf.

    omv 8.1.1-1 synchrony | 6.17 proxmox kernel

    plugins :: omvextrasorg 8.0.2 | kvm 8.0.7 | compose 8.1.5 | cterm 8.0 | borgbackup 8.1.7 | cputemp 8.0 | mergerfs 8.0 | scripts 8.0.1 | writecache 8.1.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Official Post

    I just made a print of a picture of the Orange Pi 5Plus at those dimensions and something is fishy. The chip should be about 23mmx23mm, but comes out at 22x18. I noticed that the board looked odd, because all the holes were slightly egg shaped.

    So, their official dimensions can't be correct.

    None of their pictures that I have seen is a perfect overhead pic. They are all at a slight angle. So, you won't be able to print a pic to scale as you have found.

    omv 8.1.1-1 synchrony | 6.17 proxmox kernel

    plugins :: omvextrasorg 8.0.2 | kvm 8.0.7 | compose 8.1.5 | cterm 8.0 | borgbackup 8.1.7 | cputemp 8.0 | mergerfs 8.0 | scripts 8.0.1 | writecache 8.1.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Official Post

    Yes, I saw that, but I wanted to know about the placement of the mounting holes and ports, I can estimate it, but I would like to have some precise measures, so I can make a small cabinet for it. As I live in Uruguay, it usually takes a month to get stuff.

    I ordered an Orange Pi 5 plus and should have it in a couple of days if you still need dimensions. I have a dial caliper to get exact dimensions.

    omv 8.1.1-1 synchrony | 6.17 proxmox kernel

    plugins :: omvextrasorg 8.0.2 | kvm 8.0.7 | compose 8.1.5 | cterm 8.0 | borgbackup 8.1.7 | cputemp 8.0 | mergerfs 8.0 | scripts 8.0.1 | writecache 8.1.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Virtualization and big.LITTLE architecture especially on ARM64 don't go well together.


    In fact it won't even start without CPU-Pinning and likely multiple Kernel Patches applied yourself.


    This has been a thing since 2016 and likely never will change. There's a lot of dirty workarounds to apply and even then it's likely not stable.


    That's most likely also why AMLogic has opt for Quad-Cores instead of more Cores in their latest designs.


    Same like the Raspberry Pi 4B - those don't suffer from those issues.


    TLDR: Forget about VMS - the overhead is to large for it to be worth it anyway. As long as you're using Docker everything is fine ...

  • I think its possible to do most things with docker instead of VMs. And for Windows VMs you want a x86-64 system anyway.


    jit-010101 For big.LITTLE you have to keep in mind that it allows for very low idle power consumption. And a lot of SoC get initially developed for battery powered devices where this is very important.



    I don't know how far along FrederikSchack is with his build but i doubt he will be able to achieve 3W idle with these parts. I did a lot of tests with ultra low powered ARM systems for nas and docker (I personally run NanoPi R6C with 4TB NVMe SSD at 0,85W idle) and the problems with his setup are:


    - Using SATA-SSD instead of NVMe-SSD uses much more power in idle. For example a low power NVMe-SSD like Lexar NM790 will only add ~0,1W in idle vs 1-2W for SATA-Controller and SATA-SSD. With multiple SATA-SSD problem is even worse.


    - 60W power supply like on his picture will have too low efficiency at idle and using a small 20w power supply might not be enough for OrangePi 5, SATA-Controller and multiple SATA-SSD at load.

  • STEP for Opi5 plus: https://www.thingiverse.com/thing:6096712/files or STL (different case) https://www.thingiverse.com/thing:6108054 If they both measure the same, it's safe to assume they are correct.


    Orange Pi 5 Plus Open Case V1 by John U | Download free STL model | Printables.com
    Recently purchased an Orange Pi 5 Plus and needed a case for it. Here is my 1st crack at it. | Download free 3D printable STL models
    www.printables.com

    Orange Pi 5 Plus Case by Yevgen Nikitin | Download free STL model | Printables.com
    The case for Orange Pi 5 Plus I got my calipers, measured the board, and built the case. | Download free 3D printable STL models
    www.printables.com

    Orange Pi 5 Plus Tower Case V1 by John U | Download free STL model | Printables.com
    This is my second case for the Orange Pi 5 Plus. The vents on the side pieces are a bit ambitious and resulted in some… | Download free 3D printable STL models
    www.printables.com


    Here's what I measured from the first link...


    Edited 3 times, last by olduser ().

  • At the wall, we will probably be a bit above 3W I don’t expect to ever get above 20W and I would expect that there is a small buffer for short spikes above 20W. What I’ve seen when looking around is that the Orange Pi 5 Plus uses around 8 watt when pushed hard.


    Looking forward to your comments :)

    hi, I have Opi5Plus and my measurements show as following:

    1- idle: 5W

    2- CPU stress: 11W

    I am building similar thingi to yours, started with 2 HDD (3.5" 4TB) and idle was 11W, while copying between the disks it was going up to 22W.

    But again: these are HDD not SSD.

    I am wondering if you are done with all the set up or not yet and how are you finding it. Do you use a fan on CPU or so, for disks as well?

    cheers

  • Sorry for the long delay, I got into some technical difficulties with this project and had another project that I focused on. Now I'll get back to this thing.

    I connected everything (Orange Pi 5 Plus, SATA controller and an SSD harddisk) and it seems to be running at 3.9W measured before the power adapter.

    I decided to use a power adapter with 3 USB ports, connect the Orange Pi to one port and the SATA power to the other port.

    But I have to find a driver for the SATA controller, which should be included in the normal Debian distribution, but not the Orange Pi version of Debian.

  • I have an orangepi 3B and am trying to expand more functions.


    I used an open source hard disk cabinet backplane and connected it to the GPIO pin of orangepi3B through the reserved 5V output interface on the backplane to power orangepi3B. Of course, the backplane can also power the hard disk.

    At the same time, I use a server CSPS power supply to provide 12V power supply to the hard disk cabinet backplane. For this purpose, I use an open source power conversion board.


    But I have to find a driver for the SATA controller, which should be included in the normal Debian distribution, but not the Orange Pi version of Debian.

    The SATA driver is integrated into the Linux kernel, so I think the problem is in the expansion board's conversion chip.

    Life is a boring and troublesome thing, it is annoying and stupid.

  • Do you have any links or any info on which chipset it uses?

    Due to the agreement, I cannot provide PCB drawings, and this open source platform does not accept foreigners to register accounts. However, this hard drive backplane does not have the chips required for data transmission, only 1 power module and 2 capacitors. Please search for the specific component model based on the picture.

    Life is a boring and troublesome thing, it is annoying and stupid.

  • Due to the agreement, I cannot provide PCB drawings, and this open source platform does not accept foreigners

    What the fuck kind of "Open Source" is that? I hope you're somehow making this up.

  • What the fuck kind of "Open Source" is that? I hope you're somehow making this up.

    The author has identified the CC BY-NC-SA agreement. Don't ask me what the source of this string of characters is, I don't know. In short, this is an open source sharing agreement.

    The agreement requires: Users need to follow the method specified by the creator and retain their name and source; users must not use this project for commercial purposes or use this project for profit;

    According to the requirements of the agreement, users need to purchase the drawings for 0 money in the way specified by the author.

    If you want to get the drawings, please go to this link: sz-jlc ,but registering an account is difficult.

    Life is a boring and troublesome thing, it is annoying and stupid.

  • Whatever dude... I'm a "foreigner" anyways so it's not meant for my non-nationalist dirty kind.

  • I don't know, shouldn't I be able to find the driver with modprobe?

    I tired modprobe sata and modprobe jmicron and there doesn't seem to be any such drivers.

    It has a JMicron JMB585 chipset.

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!