ZFS Plugin (ZoL upgrade possible?)

    • OMV 3.x

    This site uses cookies. By continuing to browse this site, you are agreeing to our Cookie Policy.

    • ZFS Plugin (ZoL upgrade possible?)

      Hey guys,
      the ZFS plugin seems to uses the ZoL version 0.6.5.9-2 ("modinfo zfs"). Because of this bug it is not possible to do a scrub on my pool, because the pool was originally created under a freebsd system (freenas). So as you can see the bug is fixed in 0.6.5.11, but our version is far away from this. Even the Debian stretch version is just using the 0.6.5.9-5 version. You can find the versions used in Debian here.

      However, the latest version is 0.7.1... but I would be totally satisfied with 0.6.5.11. ;)

      I think an upgrade from the lasted sources is not a good idea if I still want to use the further ZFS Plugin- or at least the apt-get - updates?! Sadly I dont even know how to do that. Maybe its possible to use a backport from Debian Buster (0.6.5.11-1)?

      The last possibility would be to destroy and rebuild the entire pool with ZoL. But even if I do that, I'd love to have a more up-to-date version...

      I hope you guys can help me!

      Greetings
      74m
    • Skaronator wrote:

      compile a newer Linux Kernel since 0.7.x doesn't work with 4.9

      74m wrote:

      Are you sure Sharonator?
      0.6.5.11 (from stretch backports) works on stretch with the 4.9 kernel
      0.6.5.11 works on buster with the 4.11 kernel.
      I also just followed these instructions and had no problems building spl-0.7.0.12/zfs-0.7.0.25 on an OMV 3.x VM with the 4.9 kernel. (I don't recommend using it because it might break something).
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!

      The post was edited 1 time, last by ryecoaaron ().

    • Okay, thanks for you feedback ryecoaaron.
      In the meantime I've chosen the second possibility by using the sloppy backports. You can find the different versions of ZoL in debian here.

      But it is good to know that it is also possible to upgrade so easy the very latest version like you did. I hope that im not running in trouble with the ZFS Plugin for omv...

      Thank you so far! :)
    • 74m wrote:

      In the meantime I've chosen the second possibility by using the sloppy backports.
      I don't think you will have problems with sloppy backports but I don't use zfs.
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • 74m wrote:

      Hmmm... Are you sure Sharonator?
      Because in the official release notes of ZoL (v. 0.7.1) you can read this: "Compatible with 2.6.32 - 4.12 Linux kernels."
      Oh I was wrong. They wrote always "Compatible with 4.12rc3" for example and I though this would be only compatible with 4.12x but they've change this part.


      ryecoaaron wrote:

      I also just followed these instructions and had no problems building spl-0.7.0.12/zfs-0.7.0.25 on an OMV 3.x VM with the 4.9 kernel. (I don't recommend using it because it might break something).
      Just did that and I got SPL compiled via make deb and now I've those deb files: kmod-spl-4.9.0-0.bpo.3-amd64_0.7.1-1_amd64.deb kmod-spl-devel-4.9.0-0.bpo.3-amd64_0.7.1-1_amd64.deb kmod-spl-devel_0.7.1-1_amd64.deb spl_0.7.1-1_amd64.deb

      How I'm supposed to update the dkms modul? If I install those deb files with dpkg -i *.deb it would update spl but not spl-dkms. Looks like this hasn't been implemented yet? github.com/zfsonlinux/zfs/issues/6044
    • Skaronator wrote:

      How I'm supposed to update the dkms modul? If I install those deb files with dpkg -i *.deb it would update spl but not spl-dkms. Looks like this hasn't been implemented yet? github.com/zfsonlinux/zfs/issues/6044
      I don't use zfs so not much help there. I guess you will have to wait.
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • Skaronator wrote:

      The problem is that my NAS just crash every few days and I assum it is due to the old Kernel. 4.9 should work with Ryzen but the real Ryzen Kernel is 4.10 which required a newer ZFS version. Maybe I consider to give FreeNAS a try.
      You can probably build the 4.11 kernel and 0.6.5.11 packages from Debian buster on your system. I doubt you will have better luck with FreeNAS due to the bleeding edge cpu. Linux is normally ahead of FreeBSD in hardware support.
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • That is kind of how you do it but it is always risky due to too many non-Jessie packages. The kernel is easy to install but the headers have too many dependencies. You can't skip the headers because zfs needs them. I will look a bit more into this but it isn't looking good (or easy).
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • Using the Ubuntu HWE 4.11 kernel and headers is the best option I can find right now. It seems to work well on my OMV 3.x VM and the zfs 0.6.5.9 seems to work with this kernel.

      Simple to install with:
      wget http://us.archive.ubuntu.com/ubuntu/pool/main/l/linux-hwe-edge/linux-image-4.11.0-14-generic_4.11.0-14.20~16.04.1_amd64.deb
      wget http://us.archive.ubuntu.com/ubuntu/pool/main/l/linux-hwe-edge/linux-image-extra-4.11.0-14-generic_4.11.0-14.20~16.04.1_amd64.deb
      wget http://us.archive.ubuntu.com/ubuntu/pool/main/l/linux-hwe-edge/linux-headers-4.11.0-14-generic_4.11.0-14.20~16.04.1_amd64.deb
      wget http://us.archive.ubuntu.com/ubuntu/pool/main/l/linux-hwe-edge/linux-headers-4.11.0-14_4.11.0-14.20~16.04.1_all.deb
      dpkg -i linux-image*
      reboot
      dpkg -i linux-headers*
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!

      The post was edited 1 time, last by ryecoaaron ().

    • Thanks @ryecoaaron for your effort but I got a error with spl and zfs when installing the headers:

      Source Code

      1. root@OMV-NAS:/home/Niklas/kernel# dpkg -i linux-headers*
      2. (Lese Datenbank ... 172072 Dateien und Verzeichnisse sind derzeit installiert.)
      3. Vorbereitung zum Entpacken von linux-headers-4.11.0-14_4.11.0-14.20~16.04.1_all.deb ...
      4. Entpacken von linux-headers-4.11.0-14 (4.11.0-14.20~16.04.1) über (4.11.0-14.20~16.04.1) ...
      5. Vorbereitung zum Entpacken von linux-headers-4.11.0-14-generic_4.11.0-14.20~16.04.1_amd64.deb ...
      6. Entpacken von linux-headers-4.11.0-14-generic (4.11.0-14.20~16.04.1) über (4.11.0-14.20~16.04.1) ...
      7. linux-headers-4.11.0-14 (4.11.0-14.20~16.04.1) wird eingerichtet ...
      8. linux-headers-4.11.0-14-generic (4.11.0-14.20~16.04.1) wird eingerichtet ...
      9. Examining /etc/kernel/header_postinst.d.
      10. run-parts: executing /etc/kernel/header_postinst.d/dkms 4.11.0-14-generic /boot/vmlinuz-4.11.0-14-generic
      11. configure: error: unknown
      12. Error! Bad return status for module build on kernel: 4.11.0-14-generic (x86_64)
      13. Consult /var/lib/dkms/spl/0.6.5.9/build/make.log for more information.
      14. ^CFailed to process /etc/kernel/header_postinst.d at /var/lib/dpkg/info/linux-headers-4.11.0-14-generic.postinst line 110.
      15. dpkg: Fehler beim Bearbeiten des Paketes linux-headers-4.11.0-14-generic (--install):
      16. Unterprozess installiertes post-installation-Skript gab den Fehlerwert 2 zurück
      17. Fehler traten auf beim Bearbeiten von:
      18. linux-headers-4.11.0-14-generic
      19. root@OMV-NAS:/home/Niklas/kernel# Error! Bad return status for module build on kernel: 4.11.0-14-generic (x86_64)
      20. Consult /var/lib/dkms/zfs/0.6.5.9/build/make.log for more information.
      21. ^C
      Display All
      And both logs just say that there are no config file for make?

      Source Code

      1. root@OMV-NAS:~# tail /var/lib/dkms/spl/0.6.5.9/build/make.log
      2. DKMS make.log for spl-0.6.5.9 for kernel 4.11.0-14-generic (x86_64)
      3. Sa 19. Aug 20:13:33 CEST 2017
      4. make: *** Keine Targets angegeben und keine »make«-Steuerdatei gefunden. Schluss.
      5. root@OMV-NAS:~# tail /var/lib/dkms/zfs/0.6.5.9/build/make.log
      6. DKMS make.log for zfs-0.6.5.9 for kernel 4.11.0-14-generic (x86_64)
      7. Sa 19. Aug 20:17:21 CEST 2017
      8. make: *** Keine Targets angegeben und keine »make«-Steuerdatei gefunden. Schluss.
      9. root@OMV-NAS:~#

      The post was edited 1 time, last by Skaronator ().

    • I will have to try to recreate what I did since I don't see zfs-dkms installed but it is a dependency of the plugin.

      Source Code

      1. # dpkg -l | grep zfs
      2. ii libzfs2linux 0.6.5.9-2~bpo8+1 amd64 OpenZFS filesystem library for Linux
      3. ii openmediavault-zfs 3.0.18 amd64 OpenMediaVault plugin for ZFS
      4. ii zfs-zed 0.6.5.9-2~bpo8+1 amd64 OpenZFS Event Daemon
      5. ii zfsutils-linux 0.6.5.9-2~bpo8+1 amd64 command-line tools to manage OpenZFS filesystems

      Source Code

      1. # lsmod | grep zfs
      2. zfs 2711552 4
      3. zunicode 331776 1 zfs
      4. zavl 16384 1 zfs
      5. zcommon 49152 1 zfs
      6. znvpair 77824 2 zcommon,zfs
      7. spl 98304 3 znvpair,zcommon,zfs

      Source Code

      1. # uname -a
      2. Linux omv3master 4.11.0-14-generic #20~16.04.1-Ubuntu SMP Wed Aug 9 09:06:22 UTC 2017 x86_64 GNU/Linux

      Source Code

      1. # dpkg -l | grep linux-
      2. ii firmware-linux-free 3.3 all Binary firmware for various drivers in the Linux kernel
      3. ii firmware-linux-nonfree 20161130-3~bpo8+1 all Binary firmware for various drivers in the Linux kernel (meta-package)
      4. ii linux-base 4.3~bpo8+1 all Linux image base package
      5. ii linux-compiler-gcc-4.9-x86 4.9.30-2+deb9u2~bpo8+1 amd64 Compiler for Linux on x86 (meta-package)
      6. ii linux-headers-4.11.0-14 4.11.0-14.20~16.04.1 all Header files related to Linux kernel version 4.11.0
      7. ii linux-headers-4.11.0-14-generic 4.11.0-14.20~16.04.1 amd64 Linux kernel headers for version 4.11.0 on 64 bit x86 SMP
      8. ii linux-headers-4.9.0-0.bpo.3-amd64 4.9.30-2+deb9u2~bpo8+1 amd64 Header files for Linux 4.9.0-0.bpo.3-amd64
      9. ii linux-headers-4.9.0-0.bpo.3-common 4.9.30-2+deb9u2~bpo8+1 all Common header files for Linux 4.9.0-0.bpo.3
      10. ii linux-headers-amd64 4.9+80~bpo8+1 amd64 Header files for Linux amd64 configuration (meta-package)
      11. ii linux-image-4.11.0-14-generic 4.11.0-14.20~16.04.1 amd64 Linux kernel image for version 4.11.0 on 64 bit x86 SMP
      12. ii linux-image-4.9.0-0.bpo.3-amd64 4.9.30-2+deb9u2~bpo8+1 amd64 Linux 4.9 for 64-bit PCs
      13. ii linux-image-amd64 4.9+80~bpo8+1 amd64 Linux for 64-bit PCs (meta-package)
      14. ii linux-kbuild-4.9 4.9.30-2+deb9u2~bpo8+1 amd64 Kbuild infrastructure for Linux 4.9
      Display All

      Source Code

      1. # zfs list
      2. NAME USED AVAIL REFER MOUNTPOINT
      3. ubuntu 61K 15.4G 19K /ubuntu
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • I just recreated the install and can confirm it doesn't install zfs-dkms. Looks like the ubuntu header package satisfies that dependency:

      Source Code

      1. # apt-cache depends openmediavault-zfs
      2. openmediavault-zfs
      3. |Depends: linux-headers-amd64
      4. |Depends: <pve-headers>
      5. Depends: linux-headers-3.16.0-4-all
      6. Depends: openmediavault
      7. Depends: openmediavault-omvextrasorg
      8. Depends: zfs-dkms
      9. linux-image-4.11.0-14-generic
      10. |Depends: zfsutils-linux
      11. Depends: <zfsutils>
      12. zfsutils-linux
      13. Depends: zfs-zed
      Display All

      So, I would guess you need to remove zfs-dkms. Made a video of the install here - github.com/OpenMediaVault-Plug…ob/master/zfs_install.gif
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • Okay got it working, thanks!

      Hope the system is now stable.

      Source Code

      1. root@OMV-NAS:~# dpkg -l | grep zfs
      2. ii libzfs2linux 0.6.5.9-2~bpo8+1 amd64 OpenZFS filesystem library for Linux
      3. ii openmediavault-zfs 3.0.18 amd64 OpenMediaVault plugin for ZFS
      4. ii zfs-zed 0.6.5.9-2~bpo8+1 amd64 OpenZFS Event Daemon
      5. ii zfsutils-linux 0.6.5.9-2~bpo8+1 amd64 command-line tools to manage OpenZFS filesystems
      6. root@OMV-NAS:~# lsmod | grep zfs
      7. zfs 2711552 4
      8. zunicode 331776 1 zfs
      9. zavl 16384 1 zfs
      10. zcommon 49152 1 zfs
      11. znvpair 77824 2 zcommon,zfs
      12. spl 98304 3 znvpair,zcommon,zfs
      13. root@OMV-NAS:~# uname -a
      14. Linux OMV-NAS 4.11.0-14-generic #20~16.04.1-Ubuntu SMP Wed Aug 9 09:06:22 UTC 2017 x86_64 GNU/Linux
      15. root@OMV-NAS:~# dpkg -l | grep linux-
      16. ii firmware-linux-free 3.3 all Binary firmware for various drivers in the Linux kernel
      17. ii firmware-linux-nonfree 20161130-3~bpo8+1 all Binary firmware for various drivers in the Linux kernel (meta-package)
      18. ii linux-base 4.3~bpo8+1 all Linux image base package
      19. ii linux-compiler-gcc-4.9-x86 4.9.30-2+deb9u2~bpo8+1 amd64 Compiler for Linux on x86 (meta-package)
      20. ii linux-headers-4.11.0-14 4.11.0-14.20~16.04.1 all Header files related to Linux kernel version 4.11.0
      21. ii linux-headers-4.11.0-14-generic 4.11.0-14.20~16.04.1 amd64 Linux kernel headers for version 4.11.0 on 64 bit x86 SMP
      22. ii linux-headers-4.8.0-0.bpo.2-amd64 4.8.15-2~bpo8+2 amd64 Header files for Linux 4.8.0-0.bpo.2-amd64
      23. ii linux-headers-4.8.0-0.bpo.2-common 4.8.15-2~bpo8+2 amd64 Common header files for Linux 4.8.0-0.bpo.2
      24. ii linux-headers-4.9.0-0.bpo.1-amd64 4.9.2-2~bpo8+1 amd64 Header files for Linux 4.9.0-0.bpo.1-amd64
      25. ii linux-headers-4.9.0-0.bpo.1-common 4.9.2-2~bpo8+1 all Common header files for Linux 4.9.0-0.bpo.1
      26. ii linux-headers-4.9.0-0.bpo.2-amd64 4.9.18-1~bpo8+1 amd64 Header files for Linux 4.9.0-0.bpo.2-amd64
      27. ii linux-headers-4.9.0-0.bpo.2-common 4.9.18-1~bpo8+1 all Common header files for Linux 4.9.0-0.bpo.2
      28. ii linux-headers-4.9.0-0.bpo.3-amd64 4.9.30-2+deb9u2~bpo8+1 amd64 Header files for Linux 4.9.0-0.bpo.3-amd64
      29. ii linux-headers-4.9.0-0.bpo.3-common 4.9.30-2+deb9u2~bpo8+1 all Common header files for Linux 4.9.0-0.bpo.3
      30. ii linux-headers-amd64 4.9+80~bpo8+1 amd64 Header files for Linux amd64 configuration (meta-package)
      31. rc linux-image-3.16.0-4-amd64 3.16.36-1+deb8u2 amd64 Linux 3.16 for 64-bit PCs
      32. ii linux-image-4.11.0-14-generic 4.11.0-14.20~16.04.1 amd64 Linux kernel image for version 4.11.0 on 64 bit x86 SMP
      33. ii linux-image-4.8.0-0.bpo.2-amd64 4.8.15-2~bpo8+2 amd64 Linux 4.8 for 64-bit PCs (signed)
      34. ii linux-image-4.9.0-0.bpo.1-amd64-unsigned 4.9.2-2~bpo8+1 amd64 Linux 4.9 for 64-bit PCs
      35. ii linux-image-4.9.0-0.bpo.2-amd64 4.9.18-1~bpo8+1 amd64 Linux 4.9 for 64-bit PCs (signed)
      36. ii linux-image-4.9.0-0.bpo.3-amd64 4.9.30-2+deb9u2~bpo8+1 amd64 Linux 4.9 for 64-bit PCs
      37. ii linux-image-amd64 4.9+80~bpo8+1 amd64 Linux for 64-bit PCs (meta-package)
      38. ii linux-kbuild-4.8 4.8.15-2~bpo8+2 amd64 Kbuild infrastructure for Linux 4.8
      39. ii linux-kbuild-4.9 4.9.30-2+deb9u2~bpo8+1 amd64 Kbuild infrastructure for Linux 4.9
      40. ii linux-libc-dev:amd64 3.16.43-2+deb8u3 amd64 Linux support headers for userspace development
      41. root@OMV-NAS:~# zfs list
      42. NAME USED AVAIL REFER MOUNTPOINT
      43. StorageZFS 23,4T 4,71T 21,6T /StorageZFS
      44. root@OMV-NAS:~#
      Display All
    • Skaronator wrote:

      Okay got it working, thanks!

      Hope the system is now stable.
      Good to hear. Only issue is that there are no auto updates for the kernel. They will have to be manually downloaded and installed.
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • Skaronator wrote:

      Are they both in the Kernel included?
      A prebuilt module is probably included in the kernel package.
      omv 4.0.5 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.0.2
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!