Hang-up in 'salt-call' : Upgrading openmediavault (5.6.13-1)

Hi,

Having recently upgraded from OMV 4, OMV 5 has been running for a week or more.

During apt upgrade, progress stopped at 33% here ...

Setting up openmediavault (5.6.13-1) ...

Creating configuration database ...

Migrating configuration database ...

Setting up Salt environment ...

Interrupted after 30 minutes
I found the script command and added -l all to see all log messages:

salt-call -l all --local --retcode-passthrough --no-color state.orchestrate \

            omv.stage.prepare >/dev/null

I hope someone can give me pointer(s) to debug the problem.

Thank you,

Dave

$ sudo apt update && sudo apt upgrade
Get:1 file:/var/cache/openmediavault/archives InRelease

Ign:1 file:/var/cache/openmediavault/archives InRelease

...

... 8< snip >8

...

Get:5 file:/var/cache/openmediavault/archives Contents (deb)

Ign:5 file:/var/cache/openmediavault/archives Contents (deb)

Hit:6 http://security.debian.org/debian-security buster/updates InRelease

Hit:7 http://ppa.launchpad.net/kyle1117/ppa/ubuntu cosmic InRelease

Hit:8 http://httpredir.debian.org/debian buster-backports InRelease

Hit:9 http://packages.openmediavault.org/public usul InRelease

Hit:10 https://openmediavault.github.io/packages usul InRelease

Hit:11 https://openmediavault-plugin-…github.io/packages/debian usul InRelease

Hit:12 https://deb.debian.org/debian buster InRelease

Hit:13 https://download.docker.com/linux/debian buster InRelease

Hit:14 https://deb.debian.org/debian-security buster/updates InRelease

Hit:15 https://deb.debian.org/debian buster-updates InRelease

Hit:16 http://armbian.systemonachip.net/apt buster InRelease

Reading package lists... Done

Building dependency tree

Reading state information... Done

All packages are up to date.

Reading package lists... Done

Building dependency tree

Reading state information... Done

Calculating upgrade... Done

0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

1 not fully installed or removed.

After this operation, 0 B of additional disk space will be used.

Do you want to continue? [Y/n]

Setting up openmediavault (5.6.13-1) ...

Creating configuration database ...

Migrating configuration database ...

Setting up Salt environment ...

[DEBUG ] Reading configuration from /etc/salt/minion

[DEBUG ] Including configuration from '/etc/salt/minion.d/openmediavault.conf'

[DEBUG ] Reading configuration from /etc/salt/minion.d/openmediavault.conf

[DEBUG ] Using cached minion ID from /etc/salt/minion_id: OdroidHC2

[DEBUG ] Using pkg_resources to load entry points

[TRACE ] The required configuration section, 'fluent_handler', was not found the in the configuration. Not loading the fluent logging handlers module.

[TRACE ] None of the required configuration sections, 'logstash_udp_handler' and 'logstash_zmq_handler', were found in the configuration. Not loading the Logstash logging handlers module.

[DEBUG ] Override __grains__: <module 'salt.loaded.int.log_handlers.sentry_mod' from '/usr/lib/python3/dist-packages/salt/log/handlers/sentry_mod.py'>

[DEBUG ] Configuration file path: /etc/salt/minion

[WARNING ] Insecure logging configuration detected! Sensitive data may be logged.

[DEBUG ] Grains refresh requested. Refreshing grains.

[DEBUG ] Reading configuration from /etc/salt/minion

[DEBUG ] Including configuration from '/etc/salt/minion.d/openmediavault.conf'

[DEBUG ] Reading configuration from /etc/salt/minion.d/openmediavault.conf

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[TRACE ] 'drill' could not be found in the following search path: '['/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/sbin', '/usr/local/bin']'

[TRACE ] 'drill' could not be found in the following search path: '['/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/sbin', '/usr/local/bin']'

[TRACE ] Error loading grains.napalm: "napalm"" (/usr/lib/python3/dist-packages/salt/grains/napalm.py) cannot be loaded: NAPALM is not installed: ``pip install napalm``

[TRACE ] Error loading grains.nxos: No host specified and no UDS found at /tmp/nginx_local/nginx_1_be_nxapi.sock

[TRACE ] Error loading grains.pending_reboot: 'pending_reboot' grain only available on Windows

[DEBUG ] Override __utils__: <module 'salt.loaded.int.grains.zfs' from '/usr/lib/python3/dist-packages/salt/grains/zfs.py'>

[TRACE ] Loading core.append_domain grain

[TRACE ] Loading core.cwd grain

[TRACE ] Loading core.default_gateway grain

[TRACE ] Loading core.dns grain

[TRACE ] Loading core.fqdns grain

[DEBUG ] Elapsed time getting FQDNs: 0.14050841331481934 seconds

[TRACE ] Loading core.get_machine_id grain

[TRACE ] Loading core.get_master grain

[TRACE ] Loading core.get_server_id grain

[TRACE ] Loading core.hostname grain

[TRACE ] Loading core.hwaddr_interfaces grain

[TRACE ] Loading core.id_ grain

[TRACE ] Loading core.ip4_interfaces grain

[TRACE ] Loading core.ip6_interfaces grain

[TRACE ] Loading core.ip_fqdn grain

[TRACE ] Loading core.ip_interfaces grain

[TRACE ] Loading core.kernelparams grain

[TRACE ] Loading core.locale_info grain

[TRACE ] Loading core.os_data grain

[TRACE ] Adding systemd grains

[TRACE ] Adding init grain

[TRACE ] Getting lsb_release distro information

[TRACE ] Getting OS name, release, and codename from distro id, version, codename

[TRACE ] 'virt-what' could not be found in the following search path: '['/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/sbin', '/usr/local/bin']'

[TRACE ] 'virt-what' could not be found in the following search path: '['/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/sbin', '/usr/local/bin']'

[TRACE ] Loading core.path grain

[TRACE ] Loading core.pythonexecutable grain

[TRACE ] Loading core.pythonpath grain

[TRACE ] Loading core.pythonversion grain

[TRACE ] Loading core.saltpath grain

[TRACE ] Loading core.saltversion grain

[TRACE ] Loading core.saltversioninfo grain

[TRACE ] Loading core.zmqversion grain

[TRACE ] Loading disks.disks grain

[TRACE ] Device mmcblk1 reports itself as an SSD

[TRACE ] Device sda reports itself as an HDD

[TRACE ] Loading extra.config grain

[TRACE ] Loading extra.shell grain

[TRACE ] Loading lvm.lvm grain

Progress: [ 33%] [#####################################...........................................................................]

Revisiting 11 hours later, while clearing the lock, it burst back into life and seems to have cleared the problem.

Closing the thread.

Dave

$ sudo apt upgrade                                  

[sudo] password for dave:

E: Could not get lock /var/lib/dpkg/lock-frontend - open (11: Resource temporarily unavailable)

E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?

$ ps aux | grep [a]pt

root 21601 0.0 0.1  9192  2136 pts/0 T 07:18 0:00 sudo apt upgrade

root 21602 0.0 1.1 53900 24432 pts/0 T 07:18 0:04 apt upgrade

$ sudo kill -9 21601

[TRACE ] Loading mdadm.mdadm grain

[TRACE ] Loading minion_process.grains grain

[TRACE ] Loading opts.opts grain

[TRACE ] Loading zfs.zfs grain

[DEBUG ] LazyLoaded zfs.is_supported

[TRACE ] 'zfs-fuse' could not be found in the following search path: '['/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/sbin', '/usr/local/bin']'

[TRACE ] 'zpool' could not be found in the following search path: '['/usr/sbin', '/usr/bin', '/sbin', '/bin', '/usr/local/sbin', '/usr/local/bin']'

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] LazyLoaded jinja.render

[DEBUG ] LazyLoaded yaml.render

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] LazyLoaded state.sls

[DEBUG ] LazyLoaded saltutil.is_running

[DEBU[1]+ Killed sudo apt upgrade

Progress: [ 80%] [G ] LazyLoaded state.check_result######################################################.......................]

[DEBUG ] Using pkg_resources to load entry points

[DEBUG ] LazyLoaded nested.output

[TRACE ] data = {'local': {'data': {'OdroidHC2': ['The function "state.orchestrate" is running as PID 17506 and was started at 2021, Jul 30 05:56:20.304824 with jid 20210730055620304824']}, 'outputter': 'highstate', 'retcode': 1}}

Processing system modifications ...

Processing triggers for openmediavault (5.6.13-1) ...

Restarting engine daemon ...

Updating locale files ...

Updating file permissions ...

Purging internal cache ...

E: Setting in Stop via TCSAFLUSH for stdin failed! - tcsetattr (5: Input/output error)

E: Setting in Stop via TCSAFLUSH for stdin failed! - tcsetattr (5: Input/output error)

W: Operation was interrupted before it could finish

^C

$ ps aux | grep [a]pt

$ ps aux | grep [d]pkg

$ sudo omv-aptclean

-----8< snip >8-----

$ sudo apt upgrade

Reading package lists... Done

Building dependency tree

Reading state information... Done

Calculating upgrade... Done

0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.