Can't Update: "AppStream system cache was updated, but problems were found: Metadata files have errors"

eptesicus · Jan 21st 2019

When attempting to update the system via 'apt update', I get the following:

Code

root@NAS01:~# apt update
Get:1 file:/var/cache/openmediavault/archives  InRelease
Ign:1 file:/var/cache/openmediavault/archives  InRelease
Get:2 file:/var/cache/openmediavault/archives  Release
Ign:2 file:/var/cache/openmediavault/archives  Release
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:5 file:/var/cache/openmediavault/archives  Translation-en_US
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:5 file:/var/cache/openmediavault/archives  Translation-en_US
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:5 file:/var/cache/openmediavault/archives  Translation-en_US
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:5 file:/var/cache/openmediavault/archives  Translation-en_US
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:5 file:/var/cache/openmediavault/archives  Translation-en_US
Get:3 file:/var/cache/openmediavault/archives  Packages [1,100 B]
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:5 file:/var/cache/openmediavault/archives  Translation-en_US
Ign:7 http://ftp.us.debian.org/debian stretch InRelease
Hit:8 http://security.debian.org/debian-security stretch/updates InRelease
Get:9 https://openmediavault.github.io/packages arrakis InRelease [12.8 kB]
Hit:10 http://ftp.us.debian.org/debian stretch-updates InRelease                                                                                 
Hit:6 http://cdn-fastly.deb.debian.org/debian stretch-backports InRelease                                      
Hit:11 http://ftp.us.debian.org/debian stretch Release
Hit:13 http://packages.openmediavault.org/public arrakis InRelease                      
Fetched 12.8 kB in 0s (19.3 kB/s)
AppStream system cache was updated, but problems were found: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz
Reading package lists... Done
E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/cache/app-info -a -e /usr/bin/appstreamcli; then appstreamcli refresh-cache > /dev/null; fi'
E: Sub-process returned an error code

Display More

Looks like that file is linked and does exist.

Code

root@NAS01:~# ls -lah /var/lib/app-info/yaml
total 12K
drwxr-xr-x 2 root root 4.0K Jan 21 10:34 .
drwxr-xr-x 3 root root 4.0K Jan 21 10:20 ..
lrwxrwxrwx 1 root root   92 Jan 21 10:20 ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz -> /var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz

Appstream status:

Code

root@NAS01:~# appstreamcli status
AppStream Status:
Version: 0.10.6


Distribution metadata:
 /usr/share/app-info
  - Empty.


 /var/lib/app-info
  - YAML: 1
  - No icons.


 /var/cache/app-info
  - Empty.


Metainfo files:
  - Found 22 components.


Summary:
Error while loading the metadata pool: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz
root@NAS01:/srv# appstreamcli refresh --verbose --force
** (appstreamcli:24526): DEBUG: Added /var/lib/app-info/yaml to metadata search path.
** (appstreamcli:24526): DEBUG: Refreshing AppStream cache
** (appstreamcli:24526): DEBUG: Searching for data in: /var/lib/app-info/yaml
** (appstreamcli:24526): DEBUG: Reading: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz
** (appstreamcli:24526): DEBUG: WARNING: Invalid DEP-11 file found. Could not parse YAML: control characters are not allowed
** (appstreamcli:24526): DEBUG: Error while updating the in-memory data pool: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz
** (appstreamcli:24526): DEBUG: Skipped writing cache file: No components to serialize.
AppStream system cache was updated, but problems were found: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz

Display More

I've refreshed the appstream cache and reinstalled appstream and libappstream4 without success. I cannot check for updates via the UI either as I get the following error:

Code

Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; apt-get update 2>&1' with exit code '100': Get:1 file:/var/cache/openmediavault/archives InRelease Ign:1 file:/var/cache/openmediavault/archives InRelease Get:2 file:/var/cache/openmediavault/archives Release Ign:2 file:/var/cache/openmediavault/archives Release Get:3 file:/var/cache/openmediavault/archives Packages Ign:3 file:/var/cache/openmediavault/archives Packages Get:4 file:/var/cache/openmediavault/archives Translation-en Ign:4 file:/var/cache/openmediavault/archives Translation-en Get:3 file:/var/cache/openmediavault/archives Packages Ign:3 file:/var/cache/openmediavault/archives Packages Get:4 file:/var/cache/openmediavault/archives Translation-en Ign:4 file:/var/cache/openmediavault/archives Translation-en Get:3 file:/var/cache/openmediavault/archives Packages Ign:3 file:/var/cache/openmediavault/archives Packages Get:4 file:/var/cache/openmediavault/archives Translation-en Ign:4 file:/var/cache/openmediavault/archives Translation-en Get:3 file:/var/cache/openmediavault/archives Packages Ign:3 file:/var/cache/openmediavault/archives Packages Get:4 file:/var/cache/openmediavault/archives Translation-en Ign:4 file:/var/cache/openmediavault/archives Translation-en Get:3 file:/var/cache/openmediavault/archives Packages Ign:3 file:/var/cache/openmediavault/archives Packages Get:4 file:/var/cache/openmediavault/archives Translation-en Ign:4 file:/var/cache/openmediavault/archives Translation-en Get:3 file:/var/cache/openmediavault/archives Packages [1100 B] Get:4 file:/var/cache/openmediavault/archives Translation-en Ign:4 file:/var/cache/openmediavault/archives Translation-en Hit:5 http://security.debian.org/debian-security stretch/updates InRelease Ign:7 http://ftp.us.debian.org/debian stretch InRelease Hit:6 http://cdn-fastly.deb.debian.org/debian stretch-backports InRelease Get:8 https://openmediavault.github.io/packages arrakis InRelease [12.8 kB] Hit:9 http://ftp.us.debian.org/debian stretch-updates InRelease Hit:10 http://ftp.us.debian.org/debian stretch Release Hit:11 http://packages.openmediavault.org/public arrakis InRelease AppStream system cache was updated, but problems were found: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz Fetched 12.8 kB in 0s (27.9 kB/s) Reading package lists... E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/cache/app-info -a -e /usr/bin/appstreamcli; then appstreamcli refresh-cache > /dev/null; fi' E: Sub-process returned an error code

This occurs on both of my NAS boxes, and I cannot get them to update. The reason why I'm trying to update is because my 10GbE NIC no longer works in the primary NAS. I have the 10GbE bonded with a 1GbE NIC for failover. The server will boot and I can use the 1GbE, but after some time (many hours), I can no longer connect to the server... But that's another issue for another thread.

Server info:

Code

root@NAS02:~# uname -r && lsb_release -a
4.18.0-0.bpo.1-amd64
No LSB modules are available.
Distributor ID: Debian
Description:    Debian GNU/Linux 9.6 (stretch)
Release:        9.6
Codename:       stretch

ryecoaaron · Jan 21st 2019

Post the output of: omv-aptclean

eptesicus · Jan 21st 2019

Quote from ryecoaaron

Post the output of: omv-aptclean

Code

root@NAS01:~# omv-aptclean
1. Cleaning apt cache files...


2. Clearing available dpkg packages...


3. Removing apt lists...
removed '/var/lib/apt/lists/_var_cache_openmediavault_archives_Packages'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch-updates_InRelease'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch-updates_main_binary-amd64_Packages'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch-updates_main_binary-amd64_Packages.diff_Index'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch-updates_main_i18n_Translation-en'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch-updates_main_source_Sources'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch-updates_main_source_Sources.diff_Index'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_Release'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_Release.gpg'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_main_binary-amd64_Packages'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_main_i18n_Translation-en'
removed '/var/lib/apt/lists/ftp.us.debian.org_debian_dists_stretch_main_source_Sources'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_InRelease'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_contrib_binary-amd64_Packages'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_contrib_binary-amd64_Packages.diff_Index'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_contrib_i18n_Translation-en'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_contrib_i18n_Translation-en.diff_Index'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_main_binary-amd64_Packages'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_main_binary-amd64_Packages.diff_Index'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_main_i18n_Translation-en'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_main_i18n_Translation-en.diff_Index'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_non-free_binary-amd64_Packages'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_non-free_binary-amd64_Packages.diff_Index'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_non-free_i18n_Translation-en'
removed '/var/lib/apt/lists/httpredir.debian.org_debian_dists_stretch-backports_non-free_i18n_Translation-en.diff_Index'
removed '/var/lib/apt/lists/lock'
removed '/var/lib/apt/lists/openmediavault.github.io_packages_dists_arrakis_InRelease'
removed '/var/lib/apt/lists/openmediavault.github.io_packages_dists_arrakis_main_binary-amd64_Packages'
removed '/var/lib/apt/lists/packages.openmediavault.org_public_dists_arrakis_InRelease'
removed '/var/lib/apt/lists/packages.openmediavault.org_public_dists_arrakis_main_binary-amd64_Packages'
removed directory '/var/lib/apt/lists/partial'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_InRelease'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_contrib_binary-amd64_Packages'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_contrib_i18n_Translation-en'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_contrib_source_Sources'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_main_binary-amd64_Packages'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_main_i18n_Translation-en'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_main_source_Sources'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_non-free_binary-amd64_Packages'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_non-free_i18n_Translation-en'
removed '/var/lib/apt/lists/security.debian.org_debian-security_dists_stretch_updates_non-free_source_Sources'


4. Purging internal cache ...


5. Removing OpenMediaVault cache packages...
removed '/var/cache/openmediavault/archives/Packages'
removed '/var/cache/openmediavault/archives/openmediavault-omvextrasorg_latest_all4.deb'


6. Creating new OpenMediaVault packages file...


7. Updating apt...
Get:1 file:/var/cache/openmediavault/archives  InRelease
Ign:1 file:/var/cache/openmediavault/archives  InRelease
Get:2 file:/var/cache/openmediavault/archives  Release
Ign:2 file:/var/cache/openmediavault/archives  Release
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:3 file:/var/cache/openmediavault/archives  Packages
Ign:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:3 file:/var/cache/openmediavault/archives  Packages
Get:4 file:/var/cache/openmediavault/archives  Translation-en
Ign:4 file:/var/cache/openmediavault/archives  Translation-en
Get:5 http://security.debian.org/debian-security stretch/updates InRelease [94.3 kB]
Get:7 https://openmediavault.github.io/packages arrakis InRelease [12.8 kB]
Ign:8 http://ftp.us.debian.org/debian stretch InRelease
Get:9 http://security.debian.org/debian-security stretch/updates/contrib Sources [1384 B]
Get:10 http://ftp.us.debian.org/debian stretch-updates InRelease [91.0 kB]
Get:11 http://security.debian.org/debian-security stretch/updates/main Sources [189 kB]
Get:12 http://security.debian.org/debian-security stretch/updates/non-free Sources [1216 B]
Get:13 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [467 kB]
Get:14 https://openmediavault.github.io/packages arrakis/main amd64 Packages [6220 B]
Get:6 http://cdn-fastly.deb.debian.org/debian stretch-backports InRelease [91.8 kB]
Get:15 http://security.debian.org/debian-security stretch/updates/main Translation-en [205 kB]
Get:16 http://packages.openmediavault.org/public arrakis InRelease [12.8 kB]
Get:17 http://security.debian.org/debian-security stretch/updates/contrib amd64 Packages [1764 B]
Get:18 http://security.debian.org/debian-security stretch/updates/contrib Translation-en [1759 B]
Get:19 http://security.debian.org/debian-security stretch/updates/non-free amd64 Packages [1600 B]
Get:20 http://security.debian.org/debian-security stretch/updates/non-free Translation-en [691 B]
Get:21 http://ftp.us.debian.org/debian stretch Release [118 kB]
Get:22 http://ftp.us.debian.org/debian stretch-updates/main Sources [3752 B]
Get:23 http://ftp.us.debian.org/debian stretch-updates/main amd64 Packages [5152 B]
Get:24 http://ftp.us.debian.org/debian stretch-updates/main Translation-en [4512 B]
Get:25 http://ftp.us.debian.org/debian stretch Release.gpg [2434 B]
Get:26 http://cdn-fastly.deb.debian.org/debian stretch-backports/main amd64 Packages [564 kB]
Get:27 http://packages.openmediavault.org/public arrakis/main amd64 Packages [6220 B]
Get:28 http://ftp.us.debian.org/debian stretch/main Sources [6751 kB]
Get:29 http://cdn-fastly.deb.debian.org/debian stretch-backports/main Translation-en [436 kB]
Get:30 http://cdn-fastly.deb.debian.org/debian stretch-backports/contrib amd64 Packages [9868 B]
Get:31 http://cdn-fastly.deb.debian.org/debian stretch-backports/contrib Translation-en [6693 B]
Get:32 http://cdn-fastly.deb.debian.org/debian stretch-backports/non-free amd64 Packages [33.3 kB]
Get:33 http://cdn-fastly.deb.debian.org/debian stretch-backports/non-free Translation-en [37.0 kB]
Get:34 http://ftp.us.debian.org/debian stretch/main amd64 Packages [7089 kB]
Get:35 http://ftp.us.debian.org/debian stretch/main Translation-en [5388 kB]
Get:36 http://ftp.us.debian.org/debian stretch/main amd64 DEP-11 Metadata [3066 kB]
Fetched 24.7 MB in 5s (4890 kB/s)
AppStream system cache was updated, but problems were found: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz
Reading package lists... Done
E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/cache/app-info -a -e /usr/bin/appstreamcli; then appstreamcli refresh-cache > /dev/null; fi'
E: Sub-process returned an error code

Display More

ryecoaaron · Jan 21st 2019

Quote from eptesicus

AppStream system cache was updated, but problems were found: Metadata files have errors: /var/lib/app-info/yaml/ftp.us.debian.org_debian_dists_stretch_main_dep11_Components-amd64.yml.gz
Reading package lists... Done
E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/cache/app-info -a -e /usr/bin/appstreamcli; then appstreamcli refresh-cache > /dev/null; fi'

All of this seems to be caused by appstream. Why are you using it? I've never even heard of it. Do you have a desktop environment installed?

eptesicus · Jan 21st 2019

Quote from ryecoaaron

All of this seems to be caused by appstream. Why are you using it? I've never even heard of it. Do you have a desktop environment installed?

I have no idea. I deployed these servers from the OMV install ISO, and I have no idea if I can remove appstream or not.

ryecoaaron · Jan 22nd 2019

Quote from eptesicus

I have no idea. I deployed these servers from the OMV install ISO, and I have no idea if I can remove appstream or not.

It is not installed by the OMV ISO and I don't know any plugins that require it. It isn't on any of my OMV installs. It is on my xubuntu laptop install. If you installed a desktop environment, it may have been installed but I would remove it.

eptesicus · Jan 22nd 2019

Quote from ryecoaaron

It is not installed by the OMV ISO and I don't know any plugins that require it. It isn't on any of my OMV installs. It is on my xubuntu laptop install. If you installed a desktop environment, it may have been installed but I would remove it.

Yep, I uninstalled it and everything seems to be working. I can't find where those came from. The GUI has never been installed and the server has only been used as dedicated NAS'. Thanks for your help!

Roh Delta · Nov 8th 2020

It seems that the component "appstream" is installed and used by OMV-Extras - Cockpit

Participate now!