upgrade done, WebGui requiring changes to be applied, generating long error message

surfer_trot · 9. Januar 2022

hello all

I had waited too long to upgrade from OMV 4..

Started yesterday and ... went to 5, then 6.

thanks to a lot of messages read on the forum, it worked +/- ...

6 is installed, is accessible via CLI and SSH, and WebGui... but no shares visible.

But as soon as I login via WebGui, I'm asked to apply changes .... and that gives me the following error message.

I have rebooted, tried various things that didn't work, so ... here I am.

There are various mentions to repositories, and Python3 ...

Not sure how to deal with them though ...

(message marked as too long, over the 10000 characters limit... nice :O)

So I have attached the whole thing as Text file ...

OMV6_issues_txt.txt

thanks !!

Chris

macom · 9. Januar 2022

From the logs:

Zitat

E: The repository 'https://deb.debian.org/debian-security bullseye/updates Release' does not have a Release file.

Is the time on your sever set correctly? If no, correct it (enable ntp) and try again.

If yes, post the output of

cat /etc/apt/sources.list

and

cat /etc/apt/sources.list.d/openmediavault-os-security.list

surfer_trot · 9. Januar 2022

hi Macom,

I've just checked the time, it's set up fine (it's just that I have copied/pasted the same long error message at various moments :)))

so:

Code

root@NAS:~# cat /etc/apt/sources.list
deb https://deb.debian.org/debian bullseye main contrib non-free
deb-src https://deb.debian.org/debian bullseye main contrib non-free

deb https://deb.debian.org/debian-security bullseye/updates main contrib non-free
deb-src https://deb.debian.org/debian-security bullseye/updates main contrib non-free

deb https://deb.debian.org/debian bullseye-updates main contrib non-free
deb-src https://deb.debian.org/debian bullseye-updates main contrib non-free

and

Code

root@NAS:~# cat /etc/apt/sources.list.d/openmediavault-os-security.list
deb http://security.debian.org/debian-security bullseye-security main contrib non-free
deb-src http://security.debian.org/debian-security bullseye-security main contrib non-free

seems clean, no ?

thanks btw

macom · 9. Januar 2022

if you run apt update there will be an error.

Comment line 5 and 6 in sources.list then apt update should work

Code

root@NAS:~# cat /etc/apt/sources.list
deb https://deb.debian.org/debian bullseye main contrib non-free
deb-src https://deb.debian.org/debian bullseye main contrib non-free

# deb https://deb.debian.org/debian-security bullseye/updates main contrib non-free
# deb-src https://deb.debian.org/debian-security bullseye/updates main contrib non-free

deb https://deb.debian.org/debian bullseye-updates main contrib non-free
deb-src https://deb.debian.org/debian bullseye-updates main contrib non-free

surfer_trot · 9. Januar 2022

thanks !

just done that and apt update did work ...

but getting into the Gui still gives a long error message - shorter though.

(after reboot)

Should I empty the cache maybe ?

Code

Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; omv-salt deploy run --no-color cronapt 2>&1' with exit code '1': NAS.WORKGROUP:
    Data failed to compile:
----------
    Rendering SLS 'base:omv.deploy.cronapt.default' failed: Jinja error: The query '//system/notification/notifications/notification[id='cronapt']' does not return the minimum number of 1 object(s).
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/salt/utils/templates.py", line 497, in render_jinja_tmpl
    output = template.render(**decoded_context)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "<template>", line 24, in top-level template code
  File "/usr/lib/python3/dist-packages/jinja2/sandbox.py", line 465, in call
    return __context.call(__obj, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/salt/loader.py", line 1235, in __call__
    return self.loader.run(run_func, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/salt/loader.py", line 2268, in run
    return self._last_context.run(self._run_as, _func_or_method, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/salt/loader.py", line 2283, in _run_as
    return _func_or_method(*args, **kwargs)
  File "/var/cache/salt/minion/extmods/modules/omv_conf.py", line 104, in get_by_filter
    objs = db.get_by_filter(
  File "/usr/lib/python3/dist-packages/openmediavault/config/database.py", line 129, in get_by_filter
    raise DatabaseException(
openmediavault.config.database.DatabaseException: The query '//system/notification/notifications/notification[id='cronapt']' does not return the minimum number of 1 object(s).

; line 24

---
[...]

# Testing:
# apt-get install --reinstall python3-lxml=4.3.2-1+deb10u2
# cron-apt -s

{% set notification_config = salt['omv_conf.get_by_filter'](    <======================
  'conf.system.notification.notification',
  {'operator': 'stringEquals', 'arg0': 'id', 'arg1': 'cronapt'},
  min_result=1, max_result=1)[0] %}
{% set email_config = salt['omv_conf.get']('conf.system.notification.email') %}
{% set refrain_file = salt['pillar.get']('default:OMV_CRONAPT_REFRAINFILE', '/etc/cron-apt/refrain') %}
[...]
---

OMV\ExecException: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; omv-salt deploy run --no-color cronapt 2>&1' with exit code '1': NAS.WORKGROUP:
    Data failed to compile:
----------
    Rendering SLS 'base:omv.deploy.cronapt.default' failed: Jinja error: The query '//system/notification/notifications/notification[id='cronapt']' does not return the minimum number of 1 object(s).
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/salt/utils/templates.py", line 497, in render_jinja_tmpl
    output = template.render(**decoded_context)
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/lib/python3/dist-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/lib/python3/dist-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "<template>", line 24, in top-level template code
  File "/usr/lib/python3/dist-packages/jinja2/sandbox.py", line 465, in call
    return __context.call(__obj, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/salt/loader.py", line 1235, in __call__
    return self.loader.run(run_func, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/salt/loader.py", line 2268, in run
    return self._last_context.run(self._run_as, _func_or_method, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/salt/loader.py", line 2283, in _run_as
    return _func_or_method(*args, **kwargs)
  File "/var/cache/salt/minion/extmods/modules/omv_conf.py", line 104, in get_by_filter
    objs = db.get_by_filter(
  File "/usr/lib/python3/dist-packages/openmediavault/config/database.py", line 129, in get_by_filter
    raise DatabaseException(
openmediavault.config.database.DatabaseException: The query '//system/notification/notifications/notification[id='cronapt']' does not return the minimum number of 1 object(s).

; line 24

---
[...]

# Testing:
# apt-get install --reinstall python3-lxml=4.3.2-1+deb10u2
# cron-apt -s

{% set notification_config = salt['omv_conf.get_by_filter'](    <======================
  'conf.system.notification.notification',
  {'operator': 'stringEquals', 'arg0': 'id', 'arg1': 'cronapt'},
  min_result=1, max_result=1)[0] %}
{% set email_config = salt['omv_conf.get']('conf.system.notification.email') %}
{% set refrain_file = salt['pillar.get']('default:OMV_CRONAPT_REFRAINFILE', '/etc/cron-apt/refrain') %}
[...]
--- in /usr/share/php/openmediavault/system/process.inc:196
Stack trace:
#0 /usr/share/php/openmediavault/engine/module/serviceabstract.inc(62): OMV\System\Process->execute()
#1 /usr/share/openmediavault/engined/rpc/config.inc(167): OMV\Engine\Module\ServiceAbstract->deploy()
#2 [internal function]: Engined\Rpc\Config->applyChanges(Array, Array)
#3 /usr/share/php/openmediavault/rpc/serviceabstract.inc(123): call_user_func_array(Array, Array)
#4 /usr/share/php/openmediavault/rpc/serviceabstract.inc(149): OMV\Rpc\ServiceAbstract->callMethod('applyChanges', Array, Array)
#5 /usr/share/php/openmediavault/rpc/serviceabstract.inc(588): OMV\Rpc\ServiceAbstract->OMV\Rpc\{closure}('/tmp/bgstatus5h...', '/tmp/bgoutputj7...')
#6 /usr/share/php/openmediavault/rpc/serviceabstract.inc(159): OMV\Rpc\ServiceAbstract->execBgProc(Object(Closure))
#7 /usr/share/openmediavault/engined/rpc/config.inc(189): OMV\Rpc\ServiceAbstract->callMethodBg('applyChanges', Array, Array)
#8 [internal function]: Engined\Rpc\Config->applyChangesBg(Array, Array)
#9 /usr/share/php/openmediavault/rpc/serviceabstract.inc(123): call_user_func_array(Array, Array)
#10 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod('applyChangesBg', Array, Array)
#11 /usr/sbin/omv-engined(537): OMV\Rpc\Rpc::call('Config', 'applyChangesBg', Array, Array, 1)
#12 {main}

Alles anzeigen

macom · 9. Januar 2022

apt install usrmerge

omv-salt stage run prepare

surfer_trot · 9. Januar 2022

thanks !

just done this :

- apparently usrmerge was already installed, no issue

- I've run the 2nd one too, and got "succeeded" everywhere, everything is green ...

but getting back into the GUI, I'm still getting the same error message...

(btw, I had tried to clear the cache via omv-firstaid and got an error message - not sure if this can help)

macom · 9. Januar 2022

Mhm, do you have settings in System >> Notification >> Settings?

If not, add some (you can remove them later) save and try apply again.

surfer_trot · 9. Januar 2022

thanks !

well, just done this, added dummy smtp server, real email adress...

saved, but when I travel back to the main screen of the Gui, same error message.

(at least my changes in the System >> Notification >> Settings have been kept)

I've explored the System >> Notification >> Notifications menu and that gives me immediately the following error:

Error The XPath query '//system/notification/notifications/notification[id='cronapt']' does not return the requested number of 1 object(s).

macom · 9. Januar 2022

please post the output of

cat /var/lib/openmediavault/dirtymodules.json

macom · 9. Januar 2022

System >> Notification >> Notifications

change the selection of "software updates" and press save and apply

macom · 9. Januar 2022

If that also does not work please post the output of

omv-confdbadm read --prettify conf.system.notification.notification

surfer_trot · 9. Januar 2022

sure !

so:

Code

root@NAS:~# cat /var/lib/openmediavault/dirtymodules.json
[
    "monit",
    "nginx",
    "cronapt",
    "proftpd",
    "cron",
    "rsync",
    "avahi",
    "samba",
    "initramfs",
    "iptables",
    "postfix",
    "apt",
    "hostname",
    "hosts",
    "ssh",
    "nfs",
    "mdadm",
    "smartmontools"

Alles anzeigen

also, for the System >> Notification >> Notifications

change the selection of "software updates" and press save and apply

I cant get to it - when I access System >> Notification >> Notifications

the whole section is blocked by the error message...

also:

Code

root@NAS:~# omv-confdbadm read --prettify conf.system.notification.notification
[
    {
        "enable": true,
        "id": "monitprocevents",
        "uuid": "6801ab86-d119-40cc-85e6-49eb5b785dda"
    },
    {
        "enable": true,
        "id": "monitloadavg",
        "uuid": "9bb14e4f-2a35-4308-8bef-85f530533ca3"
    },
    {
        "enable": true,
        "id": "monitmemoryusage",
        "uuid": "57443da2-c384-40ce-846d-772dadd041f9"
    },
    {
        "enable": true,
        "id": "monitcpuusage",
        "uuid": "1d4272b1-5f43-474a-867d-2572de969ca2"
    },
    {
        "enable": true,
        "id": "monitfilesystems",
        "uuid": "edb420e4-6cc5-4086-aa39-e1beb180838c"
    },
    {
        "enable": true,
        "id": "mdadm",
        "uuid": "4a633ed3-9240-47d2-adfe-347e5f5655d6"
    },
    {
        "enable": true,
        "id": "smartmontools",
        "uuid": "24b823fa-5485-430f-b855-f89c6c8cace1"
    }
]

Alles anzeigen

I had actived everything in the Dashboard (that's it, right ?)

macom · 9. Januar 2022

For some reason there is one block missing in the output of

omv-confdbadm read --prettify conf.system.notification.notification.

This is from my system:

Code

    {
        "enable": true,
        "id": "cronapt",
        "uuid": "394cd565-e463-4094-a6ab-12e80270e9b4"
    }

It seems to be at least one of the problems.

ryecoaaron should the missing part be added to config.xml or is there some migration missing that can be performed? This is an upgrade from 4 to 5 to 6

macom · 9. Januar 2022

Seems like ryecoaaron is not online. If you like we can try this (safer to wait for ryecoaaron, though):

Make a backup of config.xml

cp /etc/openmediavault/config.xml /etc/openmediavault/config.xml.bak

edit config.xml with nano /etc/openmediavault/config.xml

find the section with "notification" (you will see something similar to the output above and hopefully recognize it) and add the following.

Code

         <notification>
          <uuid>394cd565-e463-4094-a6ab-12e80270e9b4</uuid>
          <id>cronapt</id>
          <enable>1</enable>
        </notification>

make sure the indention is the same as with the other part.

Then close nano with Ctrl+x and Y to save.

Go back to the browser and reload the page. Try to apply.

surfer_trot · 9. Januar 2022

thanks - I'll try this in 2 hours, let's say

I'd need to get back to "normal life" a bit

many thanks anyway for your help !!

ryecoaaron · 9. Januar 2022

Zitat von macom

is there some migration missing that can be performed?

I would have to find it if it is. I would just edit the xml.

surfer_trot · 9. Januar 2022

hello again,

well, it did work, congrats and thanks both !!

Great !

I see my shares again

many thanks !

upgrade done, WebGui requiring changes to be applied, generating long error message

macom 10. Januar 2022

Jetzt mitmachen!