Posts by XYZ1

    1.) Yes, you're right I tested it and those 3 commands you mentioned including the mount point show exactly the same data:

    btrfs fi sh /srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a218144cd63

    btrfs fi df /srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a218144cd63

    btrfs dev stats /srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a218144cd63



    If you want a fully picture of the way data and metadata have been allocated. etc use: btrfs fi us mountpoint.

    2.) Yes, the command you mentioned including the mount point shows more data which is as follows,
    including that the metadata is also running in RAID1:



    3.) Okay, I will stick with RAID1 for data and metadata and not switch to RAID1 for data and RAID1C3 for metadata.


    I have enabled email notifications via the OMV GUI (="System" -> "Notification" -> "Settings" by adding the respective data from my email provider accordingly and sending the test email worked fine).


    I have also checked via the OMV GUI that such a usage warning is set for my filesystem (="Storage" -> "File Systems" -> Button "Edit" -> "Usage Warning Threshold *" set to "85%").

    However, this was selected and activated by default already.



    As you built and copied data to your 4 device BRTFS RAID1 filesystem ins stages, I'd do one full balance now. It will take a couple of hours to complete. You should not need a full balance in the future unless disks are replaced. A regular "filtered" balance of data only at say 5%, in step with your backup schedule would be useful. See: https://wiki.tnonline.net/w/Btrfs/Balance.


    4.) With "full balance" you mean the following command according to the link you've posted, right?:

    btrfs balance start


    Okay, I will try to schedule a regular "filtered" balance of data only at 5% with my backup schedule.


    Is there a way to see the progress during running such a balance or when it has been successfully completed?

    To be honest, the last time I just left it running for a couple of hours until I could also hear no read/write activity from the HDDs anymore. ;)

    First of all thank you very much for supporting me during this journey!



    1.) In the meantime I've managed to perform the following steps:


    - Update BIOS and firmware on the HP MicroServer Gen8

    - Install OMV 7.X on the HP MicroServer Gen8

    - Add the new 4x 3TB 3.5'' SATA HDDs to the HP MicroServer Gen8 and create a BTRFS RAID1

    - Copy the data from the old 2x 4TB 3.5'' SATA HDDs EXT4 RAID1 to the new 4x 3TB 3.5'' SATA HDDs BTRFS RAID1 via Rsync

    - Add the required shared folders, users and SMB shares

    - Use WOL to wakeup the the HP MicroServer Gen8

    - Use FreeFileSync to backup the data from PC to the HP MicroServer Gen8 (=4x 3TB 3.5'' SATA HDDs BTRFS RAID1)


    - Plug-in old 2x 4TB 3.5'' SATA HDDs in EXT4 RAID1 into an external USB HDD enclosure and connect it to one of the USB 3.0 ports of the HP MicroServer Gen8

    - Mount existing old 2x 4TB 3.5'' SATA HDDs in EXT4 RAID1 file system

    - Create a local Rsync task within OMV to initiate a backup from new 4x 3TB 3.5'' SATA HDDs BTRFS RAID1 to old 2x 4TB 3.5'' SATA HDDs


    - In addition I'm thinking about using Microsoft 365 to upload at least the most important data (encrypted) to Microsoft OneDrive



    2.) According to the OMV GUI (="Storage" -> "File Systems" -> Button "Show details" the 4x 3TB 3.5'' SATA HDDs BTRFS RAID1 looks as follows:


    Does this look okay?

    Would it make sense to access the CLI of OMV via SSH, log in as root and enter the following command again/periodically?:

    sudo btrfs filesystem balance /srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a21 8144cd63 &



    3.) I have read something about BTRFS RAID1 VS. BTRFS RAID1C3 (https://www.reddit.com/r/btrfs…aid1c3_metadata_question/),

    whereas BTRFS RAID1C3 seems to be more stable in terms of possible data loss.

    So would it make sense to use BTRFS RAID1C3 instead of BTRFS RAID1?

    Thanks for the confirmation that I have created this BRTFS RAID1 correctly! :)


    In the meantime I also did the remaining part of step 4. "...Copy the 3TB of data to this new BRTFS RAID1.",
    by creating a new shared folder on the BRTFS RAID1 and copying the files via a local rsync task to it.
    As you mentioned, the available storage figure makes more sense now once I've written some data to the filesystem!



    Regarding step 6. "The drive just wiped can be now added to the BTRFS RAID1 via a CLi command, which increases its capacity to 4.5TB.":


    I can see the newly created BTRFS RAID1 (=based on 2x new 3TB 3.5'' SATA HDDs) and the remaining 2x new 3TB 3.5'' SATA HDDs which are used to temporarily store the data within OMV via "Storage" -> "File Systems" now as follows:
    loKcsyx.jpeg

    (Note: The data has been successfully copied from the 1st (=/dev/sde1) of the remaining 2x new 3TB 3.5'' SATA HDDs to the newly created BTRFS RAID1 (=/dev/sdb).)


    So is my understanding correct that to add the 3TB 3.5'' SATA HDD to the BTRFS RAID1 I would need to proceed as follows?:


    - Access the CLI of OMV via SSH and log in as root


    - Enter the following command to identify the mount point of the BTRFS RAID1:

    sudo lsblk

    (Note: In my case the mount point of the BTRFS RAID1 would be as follows, right?:
    "/srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a21 8144cd63")


    - Wipe the 3TB 3.5'' SATA HDD within OMV via "Storage" -> "Disks" -> select "/dev/sde" -> press the "Wipe" button


    - Enter the following command (sudo btrfs device add <device path> <mount point>):

    sudo btrfs device add /dev/sde1 /srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a21 8144cd63


    - Enter the following command:

    sudo btrfs filesystem balance /srv/dev-disk-by-uuid-73180add-31d0-4cac-b6ce-8a21 8144cd63 &

    I decided to proceed as follows and create a BRTFS RAID1:


    I managed to perform step 1., 2. and 3.,
    but regarding the step "4. Boot OMV7, creates a BRTFS RAID1 on the two 3TB drives just added...." I'm not sure if I have created the BRTFS RAID1 correctly?:

    - Verified if the 2x new 3TB 3.5'' SATA HDDs which I just added are visible within OMV:

    "Storage" -> "Disks"
    -> Okay, the 2x new 3TB 3.5'' SATA HDDs are visible.


    - Formatted the 2x new 3TB 3.5'' SATA HDDs as follows within OMV:

    "Storage" -> "File Systems" -> "Create and mount a file system" -> "BTFRS":

    - "Type": "BTRFS"

    - "Profile": "RAID1"

    - "Devices": 2x new 3TB 3.5'' SATA HDDs selected


    Initially I tried to create this BRTFS RAID1 via "Storage" -> "Multiple Device" but could not find the respective entries for BRTFS RAID1 at all.
    Therefore I tried to create this BRTFS RAID1 via "Storage" -> "File Systems" -> "Create and mount a file system" as mentioned above.
    Based on my understanding most likely the reason why such a BRTFS RAID1 must be created via "Storage" -> "File Systems" -> "Create and mount a file system" and not via "Storage" -> "Multiple Device" is, that it's not a kind of classic RAID anymore.


    However, I'm still confused if I have created this BRTFS RAID1 via "Storage" -> "File Systems" -> "Create and mount a file system" correctly,
    as "Storage" -> "File Systems" now shows the following information:

    Gekjsit.jpeg


    As this this BRTFS RAID1 currently is only based on 2x new 3TB 3.5'' SATA HDDs I was expecting to see a available capacity of ~2-3TiB but not 5.46TiB?

    As your only route to future capacity is expansion is by using bigger drives, I wouldn't dismiss BRTFS too quickly as it does allow you use drives of mixed sizes. For example, https://carfax.org.uk/btrfs-us…4000&d=4000&d=3000&d=3000 So unless your 4TB power on hours make the candidates for replacement, once the data migration is complete you could actually swap disks around in a BTRFS RAID1 to get a capacity of 7TB.

    Okay, I was not aware that a RAID1 can be done with 4 disks if using the file system BTRFS instead of EXT4!
    I was always thinking a RAID1 can only be done with 2 disks in general.


    But is my understanding correct that the reason why such a RAID1 can be done with 4 disks (if using BTRFS RAID1 instead of EXT4 RAID1),
    is that it's not true disk mirroring anymore but instead it is based on block-level redundancy (https://www.reddit.com/r/btrfs…do_you_really_need_raid1/ )?:

    "Btrfs RAID-1 isn't true mirroring. It's block-level redundancy, not device-level. While not a new or unique idea, it's still pretty cool - and in many important ways, a big improvement over device-level mirroring."


    If yes as it is not true disk mirroring anymore but instead it is based on block-level redundancy only,
    the amount of redundancy is not as good anymore, right?


    I have also seen some recommendations to not use BTFRS in RAID:

    Modernize your Linux Storage with btrfs!

    External Content www.youtube.com
    Content embedded from external sources will not be displayed without your consent.
    Through the activation of external content, you agree that personal data may be transferred to third party platforms. We have provided more information on this in our privacy policy.




    Personally, I'd want to move away from MD RAID5 ( raid5 write hole and lack of data integrity) another you could consider using ZFS on OMv7. A four disk RAIDZ1 gives you 9TB capacity with single disk redundancy, a RAIDDZ2 gives you 6TB capacity with two disk redundancy. A four disks arranged in the equivalent of RAID10 gives you 6TB capacity with two disk redundancy as long as you don't lose both sides of a single mirror.

    So to summarize RAIDZ1 would definitely be the better option than RAID5, right?


    I have read that compared to TrueNAS the ZFS file system is not included within OMV by default and must be added via the optional plugin OMV Extras (How do I get ZFS in OMV?).
    So is it save/reliable to use the ZFS file system in OMV, or is it more like experimental?


    I have also read that the ZFS file system heavily depends on the amount of available RAM.

    The HP MicroServer Gen8 only contains a Intel(R) Celeron(R) CPU G1610T (=2.30GHz / 2 cores / 2 threads) and 2x2GB ECC RAM,

    so would that be sufficient for the ZFS file system / RAIDZ1 at all?

    Thank you very much for these detailed instructions how data migration could be done!


    The 3rd option you mentioned with BRTFS RAID1 seems to be quite comfortable.

    However, I have read some mixed opinions about BRTFS and in the end it would only be 4x 3TB BTRFS RAID1 with a capacity of 6TB, instead of 4x 3TB RAID5 with a capacity of 9TB.

    So I would probably have to repeat more or less the same feat of data migration in the next few years, as file sizes are increasing more and more (e.g. videos recorded with a smartphone in 4K@60Hz,...).


    So I think I will go for the following option:

    Okay so at the end RAID1 doesn't really seem to work the way I originally thought.

    Which means in case one of the HDDs of a RAID1 array dies,

    you have to swap the defective HDD (to ideally the same model again) and hope that it would be possible to successfully rebuild the RAID1 array.

    As an alternative, it is not possible/safe to simply take the other HDD which is still working and backup the data to another safe location.


    But this also means (to answer my own question from above) it would be okay to switch from RAID1 to RAID5,

    as at the end "RAID is not a backup" and in addition to my NAS I would need to have another backup somewhere else anyway.


    I'm still facing the challenge how to do the data migration of the old 2x 4TB 3.5'' SATA HDDs running in RAID1 but I will find a solution.

    Once I have temporarily copied the data from the old 2x 4TB 3.5'' SATA HDDs running in RAID1,

    I will try to update the BIOS and firmware on the HP MicroServer Gen8 accordingly.

    Afterwards I will install OMV 7 from scratch on the HP MicroServer Gen8 and create a RAID5 array based on the 4x new 3TB 3.5'' SATA HDDs.

    Once this RAID5 array has successfully created I will copy the old data back to it.


    As mentioned above, in addition to my NAS I would need to have another backup somewhere else also.

    XYZ1 What a pity you haven't got new 4TB's rather than new 3TB HDDS, as with two free bays in you microserver migrating the data could have relatively straightforward. I'm I right in assuming that more than 3TB of data is stored on OMV.

    Yes, I'm running out of storage space on the existing 2x 4TB 3.5'' SATA HDDs in RAID1.


    But I got the 4x new 3TB 3.5'' SATA HDDs relatively cheap and thought it might be a good option to run them in RAID5.


    But how do you mean with 2x new 4TB 3.5'' SATA HDDs instead, data migration could have been relatively straight forward?:

    - Add one of the new 4TB 3.5'' SATA HDDs into the HP MicroServer Gen8

    - Temporarily copy the data from the old 2x 4TB 3.5'' SATA HDDs running in RAID1 onto the new 4TB 3.5'' SATA HDD

    - Create a new RAID5 with 3x 4TB 3.5'' SATA HDDs (=based on 2x old ones and 1x new one)

    - Copy the data temporarily stored on one of the new 4TB 3.5'' SATA HDD to the new RAID5 with 3x 4TB 3.5'' SATA HDDs



    You can't simply use one of the old 4TB while its part of a RAID1. It is possible to remove a single drive from a RAID1 mirror and re-format it in OMV but it leaves the RAID1 running in degraded mode and your data is at risk. So how precious is the data stored on OMV? Is losing it all just an inconvenience, or a disaster?

    Okay, but how is the handling of a RAID1 array supposed to be in case one the HDDs dies?

    My assumption was that in this case you can either rebuild the RAID1 by swapping the defective HDD.

    Or simply take the other HDD which ist still working and backup the data to another safe location.

    First of all, thank you very much for your replies!


    IMHO The easiest thing would be to get an external drive that is big enough to take all your data. Then backup the data to that. Set up a new server in the configuration you want and then copy the data to that new drives.

    I had a look and according to the OMV 4 GUI ("Storage" -> "File Systems") the old 2x 4TB 3.5'' SATA HDDs running in RAID1 are not using NTFS but ext4 as the file system.


    My Windows 11 based PC is not able to read ext4 formatted HDDs by default.

    So for data migration it would not be possible to just plug one of the old 4TB 3.5'' SATA HDDs into my PC,

    and then copy the data over LAN via FreeFileSync to the new 4x 3TB 3.5'' SATA HDDs running in RAID5 on the HP MicroServer Gen8.

    This would require some kind of additional error-prone steps (using WSL,... (https://windowsreport.com/ext4-windows-11/)).


    But possible I want to avoid buying an external >=4TB USB HDD for this kind of one time data migration step.

    I also have an external 3.5'' SATA to USB enclosure.

    So would it be possible to just plug one of the old 4TB 3.5'' SATA HDDs into it,

    directly connect it to the HP MicroServer Gen8 via one of the USB ports and then copy the data to the new 4x 3TB 3.5'' SATA HDDs running in RAID5?



    There's no direct upgrade path from OMV4 to OMV7. TBH, if your OMV config is relatively simple, I'd just create a new OMV install using latest OMV7 and then configure that.

    Okay, so in case I try to perform the upgrade from OMV 4 to 7 instead of doing a re-installation of OMV 7 from scratch,

    I need to follow the steps mentioned above after every single upgrade (OMV 4 -> 5 -> 6 -> 7) as it would not be possible to skip versions.


    Maybe I create a backup of the 2.5'' SATA SSD containing the OMV 4 operating system first and try to perform the upgrade.

    In case it fails I would do a re-installation of OMV 7 from scratch.



    If you move from using 2 to 4 HDD bays, you need to think about how you will boot your microserver and where you install OMV. (For example ssd in the optical drive bay, booting form a separate USB mem stick which holds the GRUB bootloader, or using the internal USB header with a USB to SATA cable to connect to your SSD, or actually running from OMV from a USB stick or SD card. )

    This would not be an issue, as the 2.5'' SATA SSD containing the OMV 4 operating system is mounted within the ODD drive bay and I'm also using a SD card containing the GRUB bootloader already.



    How much storage do you need? Do you already have the 4 x 3TB drives? There may be better 3 drive combos that allow to keep your SSD in the leftmost bay and install on and boor from your SSD.

    As with the current 2x 4TB 3.5'' SATA HDDs in RAID1 I'm running out of storage space,

    I would at least need 6TB of storage space.

    Yes, I already have the 4x new 3TB 3.5'' SATA HDDs.



    Data migration will depend to some extent what drive config you settle on and will probably need some juggling. But the big question here is the continued use of FreeFileSync. Correct me if I'm wrong, but I thought this software was definitely windows file system to windows file system. So are you mounting an OMV SMB share to your PC before you execute your batch job? OMV can only make very limited use of NTFS.

    Yes, I had a look and according to the OMV 4 GUI ("Storage" -> "File Systems") the old 2x 4TB 3.5'' SATA HDDs running in RAID1 are not using NTFS but ext4 as the file system.
    Every couple of days/weeks I power up the HP MicroServer Gen8 via Wake On LAN (WOL) which is providing a SMB share to my Windows 11 PC,

    then initiate a backup by automatically copying the new/updated files from my PC to it over LAN using a pre-defined FreeFileSync batch job.




    Thanks and best regards

    Hi OMV community,


    I have installed Open Media Vault (OMV) 4 on a HP MicroServer Gen8 back in 2018.

    It contains a 2.5'' SATA SSD for the Open Media Vault (OMV) 4 operating system and 2x 4TB 3.5'' SATA HDDs in RAID1 for backup.


    Every couple of days/weeks I power up the HP MicroServer Gen8 via Wake On LAN (WOL),

    then initiate a backup by automatically copying the new/updated files from my PC to it over LAN using a pre-defined FreeFileSync batch job.


    So far it worked without any problems,

    but now I'm running out of storage space and would need some general guidance how to proceed.



    1.) Upgrade from OMV 4 to 7:


    Is it possible/recommended to perform an upgrade from OMV 4 to the latest version OMV 7?


    If yes, I would follow the steps included within the following thread (RE: Is there a guide to in place upgrade?) :

    (Note: In addition, after step 1.) I would also try to update the BIOS and firmware on the HP MicroServer Gen8 accordingly.)



    2.) RAID1 VS RAID5:


    As mentioned above, currently OMV which is installed on a HP MicroServer Gen8 contains 2x 4TB 3.5'' SATA HDDs running in RAID1 for backup but I'm running out of storage space.


    The HP MicroServer Gen8 only has 4x 3.5'' drive bays in total.

    So my plan is to replace these 2x 4TB 3.5'' SATA HDDs running in RAID1,

    with 4x new 3TB 3.5'' SATA HDDs running in RAID5 instead.


    But is switching from RAID1 to RAID5 a bad idea for home user backup (emails, photos,...) in terms of reliability and data recovery?



    3.) Data Migration:


    As the HP MicroServer Gen8 only has 4x 3.5'' drive bays in total,

    how do I migrate the data from the existing 2x 4TB 3.5'' SATA HDDs running in RAID1 to the new 4x 3TB 3.5'' SATA HDDs running in RAID5?


    If I remember correctly, the old 2x 4TB 3.5'' SATA HDDs running in RAID1 are using NTFS as a file system.


    For example is it possible to just plug one of the old 4TB 3.5'' SATA HDDs into my PC,

    and then copy the data over LAN via FreeFileSync to the new 4x 3TB 3.5'' SATA HDDs running in RAID5 on the HP MicroServer Gen8?




    Thanks and best regards

    Hi,


    I've installed the UrBackup plugin on my NAS with OMV 4.1.3-1 and the UrBackup client on my PC.


    1.) The backup itself seems to be working fine as I can browse the files which have been backed up via the UrBackup web interface ("Backups" -> "Clients") when logging in as default user (=admin).
    I've also created a second user (=user) which can browse the files via the UrBackup web interface ("Backups" -> "Clients") as well.
    However, is it also possible to map the respective folder so that it can be accessed via the Windows Explorer?



    2.) It seems like UrBackup is creating the following "Backup storage path" automatically during the installation:
    "/media/BACKUP/urbackup"


    Is it possible to change this folder?
    How can I display and or access this folder via OMV and provide the content to the user?



    3.) What must be entered into the following field:
    "Server URL:"


    If I try to enter the IP address of my NAS with OMV installed I'm getting the following error message:
    "The server URL should be an URL starting with http:// or https://"


    However, as far as I know I don't have an URL starting with http:// or https:// for my NAS with OMV installed.





    Thanks and best regards!

    Hi,


    first of all thanks for your reply!


    Is my understanding correct that you are using Duplicati for backup the files from the NAS to the cloud as it does support encryption whereas UrBackup doesn't?


    If yes, why are you not using Duplicati for both tasks (1. Backup PC -> NAS / 2. Backup NAS -> Cloud)?



    Thanks and best regards!

    Hi,


    I'm still using OMV version 1.X and have the following hardware:
    - HP ProLiant MicroServer N54L
    - 1x Kingston SSD (OMV installed)
    - 2x Western Digital Caviar Green (WD15EARS-00Z) in RAID1


    Based on my understanding a version upgrade makes no sense,
    so I will do a clean reinstall of OMV using the latest version and use 2 new harddisks (most likely Western Digital Red) for the RAID1.


    Currently I've created some SMB shares and backup my data from PC, Notebook,... to OMV manually every couple of weeks via copy and paste only.



    What would be the best approach to backup data (photos, documents, Outlook PST files,...) from specific folders on PC, Notebook and Smartphone (Android based) to OMV within a home network automatically?
    Based on my understanding this should be one of the most basic and common tasks for a NAS despite from providing files and media within a network.
    The files should be stored in a non-prorietary format.


    However, there seems to be no simple and reliable solution at least for build your own NAS type of devices.


    Some people are using the available rsync plugin and versioning,
    however both machines must be powered on at the same time and there are some warnings that sync is not a backup.


    Some people are using Syncthing which is open source and even available for Android.
    However, even Syncthing claimes on there website that it's not recommended for backup puposes (https://docs.syncthing.net/users/faq.html:(


    - Should I use a 3rd party open software like Duplicati (no Android support)?


    - Should I use a commercial software like Acronis True Image 2018?


    - Should I buy a Synology DS218+ and install their Cloud Station Backup tool?


    ?(



    Thanks and best regards!

    Hi,
    I've successfully installed OMV 0.4.36.



    However, now I want't to create my users and shares structure which should be as follows:


    I have two users, let's call them User_1 and User_2.


    Both users should have access to the same shares but only to specific folders, here some examples:


    \\backup\data\documents\ -> should be possible to be accessed by user_1 and user_2
    \\backup\data\documents\user_1\ -> should be possible to be accessed only by user_1
    \\backup\data\documents\user_2\ -> should be possible to be accessed only by user_2


    \\backup\media\music\ -> should be possible to be accessed by user_1 and user_2



    Is my understanding correct, that I have to create a new sharer folder via "Access Right Management" - "Shared Folders" for every folder where I want to have specific access rights based on the user?
    And for every sharer folder I have to modify the shared folder ACL?




    Thanks and best regards!

    Hi,
    I'm using OMV and have the following hardware:
    - HP ProLiant MicroServer N54L
    - 1x Kingston SSD (OMV installed)
    - 2x Western Digital Caviar Green (WD15EARS-00Z) in RAID1


    I've read that Western Digital Caviar Green are not 100% optimal for NAS.



    I have the following questions regarding the settings of the 2x Western Digital Caviar Green (WD15EARS-00Z) in RAID1:


    - Under "Storage" - "Physical Disks" - "Edit" I can change the physical disk properties:

    Which settings would you recommend for the 2x Western Digital Caviar Green (WD15EARS-00Z) in RAID1?


    - Under "Storage" - "S.M.A.R.T." I can do the following settingss:

    Which settings would you recommend for the 2x Western Digital Caviar Green (WD15EARS-00Z) in RAID1?




    Thanks and best regards!

    Hi,
    I want to buy the HP ProLiant MicroServer N54L and use Open Media Vault with 2x 1.5TB harddisks in RAID1.


    Additionally to the external USB ports, the N54L also has one internal USB port.
    Based on my understanding and according to the Wiki (http://wiki.openmediavault.org/index.php?title=Installation) it would be possible to install Open Media Vault "on" a USB stick.
    However, accordingto the Wiki it's not recommended:

    Quote

    USB sticks are not recommended as boot device.


    What is your experience?
    Are there any disadvantages?




    Thanks and best regards!


    P.S.: I was also searching for this topic within the forum but could only find how to install Open Media Vault "from" a USB stick, whereas I want to install it "on" a USB stick.