[Backup Plugin] dd full disk backup failed - zstd: error while loading shared libraries

    • Offizieller Beitrag

    I can't reproduce on my RPi4 or helios64. I will need to try on my RPi5 when I get a chance. I will look at the commands in the backup script again but I think there is something wrong with the zstd package in the arm64 debian repo. Someone will need to file a bug report for that.

    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • That makes sense to me—thank you! I'll wander over there and will file a report if there isn't one already. Thanks again!

    OMV 7.4.8-1 (Sandworm)


    Hardware

    Raspberry Pi 5 Model B Rev 1.0, 8 GB RAM

    32 GB SanDisk micro SD card

    4 x 1 TB HDD in RAID5 (EXT)


    Kernel

    Linux 6.6.47+rpt-rpi-2712

  • Here's a copy of the bug report I just filed w/ Debian.


    Package: zstd

    Version: 1.5.4+dfsg2-5

    Followup-For: Bug #1034012


    Dear Maintainer,


    I am running a clean install of Raspian OS on a Raspberry Pi 5 w/ 8 GB RAM on a 32 GB microSD w/ OMV 7.


    When I run the backup plugin, it calls dd and zstd to create a compressed image of the entire drive.


    Right now, the compressed image is around 800 MB, so less than 1:32 compression ratio.


    zstd runs correctly only ONCE---but somehow breaks itself and/or liblz4-1, such that the backup

    will not run (segmentation faults or finds corrupted libraries). When I reinstall those packages,

    the backupu (zstd) will gain run correctly ONCE, but breaks itself again.


    I checked the brand-new microSD with f3, and it has 0.00 errors.


    I did a clean install of the entire system again, but the problem repeats itself.


    I upgraded to zstd 1.5.6 testing to see if the bug had been fixed there, but the same problem occurs.


    I have not tried the unstable branch.


    Thank you very much!



    *** Reporter, please consider answering these questions, where appropriate ***


    * What led up to the situation?

    * What exactly did you do (or not do) that was effective (or

    ineffective)?

    * What was the outcome of this action?

    * What outcome did you expect instead?


    *** End of the template - remove these template lines ***



    -- System Information:

    Debian Release: 12.7

    APT prefers stable-updates

    APT policy: (500, 'stable-updates'), (500, 'stable-security'), (500, 'stable'), (100, 'testing')

    Architecture: arm64 (aarch64)

    Foreign Architectures: armhf


    Kernel: Linux 6.6.47+rpt-rpi-2712 (SMP w/4 CPU threads; PREEMPT)

    Kernel taint flags: TAINT_CRAP

    Locale: LANG=C.UTF-8, LC_CTYPE=C.UTF-8 (charmap=UTF-8) (ignored: LC_ALL set to C.UTF-8), LANGUAGE not set

    Shell: /bin/sh linked to /usr/bin/dash

    Init: systemd (via /run/systemd/system)


    Versions of packages zstd depends on:

    ii libc6 2.36-9+rpt2+deb12u8

    ii libgcc-s1 12.2.0-14

    ii liblz4-1 1.9.4-1

    ii liblzma5 5.4.1-0.2

    ii libstdc++6 12.2.0-14

    ii zlib1g 1:1.2.13.dfsg-1


    zstd recommends no packages.


    zstd suggests no packages.


    -- no debconf information

    OMV 7.4.8-1 (Sandworm)


    Hardware

    Raspberry Pi 5 Model B Rev 1.0, 8 GB RAM

    32 GB SanDisk micro SD card

    4 x 1 TB HDD in RAID5 (EXT)


    Kernel

    Linux 6.6.47+rpt-rpi-2712

  • I actually just tested the "unstable" version, and it APPEARS that the bug has been fixed there (zstd 1.5.6+dfsg-1).

    OMV 7.4.8-1 (Sandworm)


    Hardware

    Raspberry Pi 5 Model B Rev 1.0, 8 GB RAM

    32 GB SanDisk micro SD card

    4 x 1 TB HDD in RAID5 (EXT)


    Kernel

    Linux 6.6.47+rpt-rpi-2712

  • Well, I rebooted and ... the same bug returned. So ... on my system, the bug has NOT been fixed, even in the unstable branch.

    OMV 7.4.8-1 (Sandworm)


    Hardware

    Raspberry Pi 5 Model B Rev 1.0, 8 GB RAM

    32 GB SanDisk micro SD card

    4 x 1 TB HDD in RAID5 (EXT)


    Kernel

    Linux 6.6.47+rpt-rpi-2712

    • Offizieller Beitrag

    I wrote a new image and configured OMV7 on my RPi5. I just tried the backup four times with a reboot between each one. Not one failure and I didn't have to reinstall.

    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • FDanee

    Hat das Label gelöst entfernt.
    • Offizieller Beitrag

    Do you get the error with the following command as root (not sudo):


    zstd -T0 --fast -o /mnt/test.ddfull1.zst < /dev/mmcblk0p1

    zstd -T0 -o /mnt/test.ddfull2.zst < /dev/mmcblk0p1

    zstd --fast -o /mnt/test.ddfull3.zst < /dev/mmcblk0p1

    zstd -o /mnt/test.ddfull4.zst < /dev/mmcblk0p1

    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Do you get the error with the following command as root (not sudo):


    I tried these while zstd was in a "bad" state, I am getting segfaults on all four:

    • Offizieller Beitrag

    That tells me that the problem isn't a specific option that the plugin is using with zstd.


    Does this segfault?

    zstd -o /mnt/test.ddfull5.zst -1 < /dev/mmcblk0p1


    If it does, then what is the output of:

    strace zstd -o /mnt/test.ddfull6.zst < /dev/mmcblk0p1

    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    It does not:

    but the other commands are still segfaulting?

    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • but the other commands are still segfaulting?

    No, they are not, all of them completed fine. Also, I was able to do three dd full disk backups one after another via the web UI (earlier it always failed after one.)


    Recap of this last leg of testing:


    1. Commands segfaulting:

    2. The Pi was restarted.

    3. No segfaults on any of these

    zstd -o /mnt/test.ddfull5.zst -1 < /dev/mmcblk0p1

    zstd -T0 --fast -o /mnt/test.ddfull1.zst < /dev/mmcblk0p1

    zstd -T0 -o /mnt/test.ddfull2.zst < /dev/mmcblk0p1

    zstd --fast -o /mnt/test.ddfull3.zst < /dev/mmcblk0p1

    zstd -o /mnt/test.ddfull4.zst < /dev/mmcblk0p1

    4. 3 successful dd full disk backups via web UI.


    • Offizieller Beitrag

    I can't explain this behavior. It would be very interesting to see an strace when the command(s) did segfault. I still haven't been able to get my RPi5 to segfault.

    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • I restarted the Pi again, tried to run a backup from the web UI and lo and behold, it is failing again. No segfault this time, but the first error I described in the opening post:

    zstd: error while loading shared libraries: LZ4_versionString: cannot open shared object file: No such file or directory


    Here is the strace:

    • Offizieller Beitrag

    My system is looking for actual libs. I have no idea why your system is looking for what seem to be template file names.


    omv 7.7.10-1 sandworm | 64 bit | 6.11 proxmox kernel

    plugins :: omvextrasorg 7.0.2 | kvm 7.1.8 | compose 7.6.10 | cterm 7.8.7 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.3.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!