Is ZFS supported in Kernel 4.13-4.15?

    • Offizieller Beitrag

    You forgot spl-dkms

    It's there now.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    Just to add to the confusion. I have two setups, one a test vm that has been updated from the first 4.0 was available. This one has 4.9 kernel as the latest update available. This would have had the 4.0.7 omv update run on it.


    The other is a machine that has run omv for many years. I decided to update it from omv 2.x to 3 or 4 and use zfs. Upgrade command to 3 ran fine but there were some problems. Decided to see what upgrading to 4 would do for fum. Still had some issues so I did a clean install of 3.0 86 and upgraded that to 4. This one updated to the 4.13 kernel.


    Shouldn't the 4.0.7 update been included in the 4.0.9 update? Or is there some other way to fix it so I can use zfs?


    PS: Shouldn't this be in the bugtracker?

    • Offizieller Beitrag

    Shouldn't the 4.0.7 update been included in the 4.0.9 update?

    Yes but it doesn't execute omv-mkconf apt. Plenty of things do that in the web interface including omv-extras now. If a person has the backports default that post above set to no, you will never get it.


    But for future reference, when upgrading from latest(last?) OMV3 to OMV4 do I need to enable both pre-release updates and community-maintained updates along with testing plugin repos etc.?

    I never enable the pre-release updates or community maintained updates.


    Or is there some other way to fix it so I can use zfs?

    Why can't you use zfs? Because you have the 4.13 kernel?


    Shouldn't this be in the bugtracker?

    I didn't submit a bugtracker because I submitted a pull request to the github repo.


    Personally, I don't think a lot of the problems are valid because OMV 4.x was adopted too early. Most of them are easily fixable from the command line.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    Ok I found out what is pushing the 4.13 key. I installed the 3.86 iso update to latest 3.x. Then omv-release-upgraded to 4.x. Updated to the 4.0.9 and still no 4.13 kernel offered.


    I then did wget http://omv-extras.org/openmediavault-omvextrasorg_latest_all4.deb and dpkg -i openmediavault-omvextrasorg_latest_all4.deb. After that

    Code
    apt-get -s upgrade                                              Reading package lists... Done
    Building dependency tree
    Reading state information... Done
    You might want to run 'apt --fix-broken install' to correct these.
    The following packages have unmet dependencies:
     openmediavault-omvextrasorg : Depends: dirmngr but it is not installed
    E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).


    After installing dirmngr from web ui and checking for updates the 4.13 kernel shows up.




    FYI

    • Offizieller Beitrag

    After installing dirmngr from web ui and checking for updates the 4.13 kernel shows up.

    apt-get -f install should have fixed that.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    apt-get -f install should have fixed that.

    Ether apt-get -f install or install from web ui will get past that. Installing openmediavault-zfs from the web ui causes errors. apt-get -f install shows this

    I am guessing as above it's due to the 4.13 kernel.


    FYI

    • Offizieller Beitrag

    I am guessing as above it's due to the 4.13 kernel.

    Yep, you probably don't have the linux headers installed for the 4.13 kernel and the zfs module included with stretch won't compile on 4.13.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • The question should be why does omv-extras force the upgrade to 4.13 kernel and can that be fixed?

    OMV doesn't force the 4.13 kernel. Debian Backports does. Just disable the Backports if you don't want them.

    OMV 4 - Ryzen 7 1700 (8 Cores / 16 Threads 65W TDP) - 32 GB DDR4 ECC
    128 GB OS SSD - 256 GB Plex SSD - 32 TB RAIDZ2 (6x8TB HGST NAS)

  • OMV doesn't force the 4.13 kernel. Debian Backports does. Just disable the Backports if you don't want them.

    Of course OMV forces the kernel 4.13 due to its convoluted pinning under /etc/apt/ meaning it tracks backport kernels not stable kernels. Doesn't appear that simple as just disabling backports (which and what changes should be made?). The reason the zfs plugin pulls kernel 4.13 is the pinning for omv-extras:



    Also, don't forget as of debian 9, zfs modules are in contrib, but the default sources.list for omv does not have contrib or non-free:


    • Offizieller Beitrag

    The question should be why does omv-extras force the upgrade to 4.13 kernel and can that be fixed?

    The reason the zfs plugin pulls kernel 4.13 is the pinning for omv-extras:

    We can't win... People bitch if the kernel is too old and now people bitch if the kernel is too new. Just remember you are using an unreleased version... Here are the actual facts:


    1 - omv-extras does not enable the backports kernel. It does pin the zfs packages IN CASE the backports kernel is installed. Otherwise, the backports zfs packages which are required for the backports kernel (yes, I realize they don't work with the 4.13 kernel YET) would not be installed when the backports kernel is installed. These pinnings do NOTHING if the backports repo isn't enabled and it isn't enabled unless the next point applies.


    2 - OMV 3.x and 4.x by default will enable the backports repo and pin the kernel because of this line. The fact does not exist in the defaults file therefore defaults to yes. If you set OMV_APT_USE_KERNEL_BACKPORTS="no" in /etc/default/openmediavault and execute omv-mkconf apt, the backports kernel and zfs packages will not be installed (no, it won't uninstall them if they are already installed).



    Also, don't forget as of debian 9, zfs modules are in contrib, but the default sources.list for omv does not have contrib or non-free:

    Where? I see them in wheezy, sid, and experimental but not stretch or even buster. Package list


    On an OMV 4.x system with backports enabled:
    $ apt-cache search zfs-modules
    zfs-dkms - OpenZFS filesystem kernel modules for Linux

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • @ryecoarron


    Not bitching, just trying to answer @donh question and understand what is happening, for my sake and possibly others. And of course, I appreciate this is an unreleased version.


    The package list you pointed to all ends in contrib in red. The point I was making was if you decided to disable stretch-backports in OMV4, thinking it might be a workaround to getting the zfs plugin to work, or thought you'd just install the required zfs packages at the CLI, apt-get in OMV4 doesn't find the stretch stable versions. You have to edit OMV4's default sources.list file.


    No one should object to having the latest kernel if you can easily revert to an earlier working kernel, which the WebUI provides for, should problems arise. Having a plugin that always pulls the latest kernel and fails to work is another, but related, issue.


    I realise now, that my answer to the OP's question should simply have been: "The zfs modules do not build against kernel 4.13 because of a bug. Check dkms status to ensure you still have zfs modules built for previous kernel. Set default boot kernel in WebUI to previous kernel. No need to change anything else, but don't update kernel again until you know problem has been fixed"


    Of course, this is not an answer to someone who has recently updated to OMV4 and just decided that they would like to use zfs.

    • Offizieller Beitrag

    The package list you pointed to all ends in contrib in red. The point I was making was if you decided to disable stretch-backports in OMV4, thinking it might be a workaround to getting the zfs plugin to work, or thought you'd just install the required zfs packages at the CLI, apt-get in OMV4 doesn't find the stretch stable versions. You have to edit OMV4's default sources.list file.

    We are talking about two different things. I realize that the zfs stuff is in contrib. I was pointing out that there are no zfs modules in stretch or buster even in contrib. As for contrib not being in sources.list, I guess we will have to look at that.


    Having a plugin that always pulls the latest kernel and fails to work is another, but related, issue.

    No plugin pulls the latest kernel. If you have backports enabled and install zfs, sure you will get the latest kernel but why do you have backports enabled then? If you have a backports kernel installed (say 4.12), installing the zfs plugin shouldn't install 4.13. And the failing will stop once the backports kernel stabilizes at a version.


    Not bitching, just trying to answer @donh question and understand what is happening, for my sake and possibly others. And of course, I appreciate this is an unreleased version.

    This is still a lot of posts to "discuss" how something unreleased works.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • No plugin pulls the latest kernel. If you have backports enabled and install zfs, sure you will get the latest kernel but why do you have backports enabled then? If you have a backports kernel installed (say 4.12), installing the zfs plugin shouldn't install 4.13. And the failing will stop once the backports kernel stabilizes at a version.


    Yes, that does seems logical, but it's not exactly what is happening. Here is my test:


    1. Fresh install from 3.0.86 iso fully upated to OMV 3.0.91, with jessie-backports but no plugins installed.
    2. Upgrade from OMV 3.0.91 to OMV 4.0.9 using "omv-release upgrade"
    3. After reboot to OMV4, kernel is already from stretch-backports:



    4. Still had to use omv-mkconf apt / apt-get update get correct openmediavault-kernel-backports.list



    5. Uploaded and installed omv4 extras


    6. Check package status:



    Code
    root@omv-vm:~# dpkg -l | grep openmed
    ii  openmediavault                  4.0.9-1                        all          openmediavault - The open network attached storage solution
    ii  openmediavault-keyring          1.0                            all          GnuPG archive keys of the OpenMediaVault archive
    ii  openmediavault-omvextrasorg     4.1.0                          all          OMV-Extras.org Package Repositories for OpenMediaVault
    root@omv-vm:~# dpkg -l | grep -Ew "zfs|spl"
    root@omv-vm:~#


    7. No system package upgrade done yet. NOTE: no kernel headers are installed on system by default at this stage,


    8. Attempt to install zfs plugin via webUI. Zfs plugin install fails, error messages show plugin has installed later backport kernel 4.13 and headers, spl/zfs module build has failed.


    9. Post fail of zfs plugin package check:




    openmediavault-zfs failed to install properly, but has added packages to system and is itself shown as installed.


    So despite there already being an active backport kernel on my OMV4 test install, zfs pluign has installed the latest 4.13 kernel because active kernel was from jessie-backports not stretch-backports. I thought if you did an upgrade from jessie to stretch on a straight Debian install, you would end up with a new stable stretch kernel. So does a OMV release upgrade do things differently?


    Output from zfs plugin is here: https://pastebin.com/mLrtnJqm

    • Offizieller Beitrag

    First off I know this is a testing work in progress. I have been testing since very early versions. Testing is to provide feedback for the future, not bitch. Don't take it personally. We are trying to contribute also.


    As of two days ago, a clean 3.86 and upgrading to 4.0.9 works fine. All updated you are still at 4.9 kernel. Installing omv-extras at cli goes fine. Checking for updates shows one update. dirmngr After that is updated without any extras installed, 4.13 kernel is an available update. Adding the zfs pluggin will pull in the 4.13 kernel.



    Could there be a switch to not change to a new kernel version unless checked? Unfortunately I don't know what else that might break.



    Thanks

    • Offizieller Beitrag

    Could there be a switch to not change to a new kernel version unless checked? Unfortunately I don't know what else that might break.

    You asking for a change in apt/dpkg behavior which we cannot change.


    Testing is to provide feedback for the future, not bitch. Don't take it personally. We are trying to contribute also.

    I get it and I'm not taking it personally and I think you should contribute. The problem is that this is a lot of time spent on a temporary problem and the feedback just seems a little upset that zfs is broken because Debian not OMV released a new kernel but didn't update the zfs packages to work with it. And no one is reading what I am posting. Please read what I post next very carefully::



    The 4.13 kernel is being installed because it is the newest kernel. The 4.9 kernel you have installed when you update from OMV 3.x to 4.x is actually the 4.9 Jessie Backports kernel not the 4.9 Stretch kernel. Since omv-release-upgrade doesn't execute omv-mkconf apt, the backports repo file stays at jessie-backports and isn't updated to stretch-backports. This makes apt not upgrade the kernel to the 4.9 stretch kernel because they are same version. When you install omv-extras, it does execute omv-mkconf apt which enables the stretch-backports repo. This will make it show up in the updates list but it will not be installed unless you tell it to. BUT if you install the zfs plugin, it has a dependency on linux-headers-amd64. This is a meta package that points to the latest linux-headers which obviously need the matching kernel. So, it installs the 4.13 kernel destroying the whole world. If you upgraded a 3.x install with the linux-headers-amd64 package from 3.x installed (which wasn't upgraded during omv-release-upgrade because it matched the available version in stretch and stretch-backports wasn't enable to get the latest stretch-backports version), then the correct headers won't be installed even if you manually installed the 4.12 kernel causing the zfs plugin to break again.


    SO, if you want a OMV 4.x install with working zfs, set the OMV_APT_USE_KERNEL_BACKPORTS="no" in /etc/default/openmediavault before upgrading to 4.x. Then you will keep the 4.9 kernel and never ever install the 4.13 kernel. When you install OMV extras and zfs plugin, the 4.9 linux headers will be installed making zfs module compiling work.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!