From overlay2 there must be some folder missing. Is there one with higher numbers than the others?
OMV Webgui not reachable
-
-
And maybe have a look in auth.log
Did you expose OMV to the internet? Any possibility to reach your OMV or a service or docker from the internet?
-
From overlay2 there must be some folder missing. Is there one with higher numbers than the others?
What do you mean with this? Which folder you are missing?
How can I look in auth.log?
Yes there is access to the internet, because I have installed plexmediaserver.
I don´t know if it possible to reach OMV or a service or docker from the internet. I have not anyone configured.
I think I didn't set up the docker system correctly with plex, I'm just not quite sure. likewise, I apparently haven't really installed the notification function properly.
-
-
As first aid measure, shut down docker and it should release some resources to analyze.
systemctl stop docker.service
-
ok, I stoped it and now?
-
This will give you a the number of files per directory:
Codefind . -maxdepth 1 -type d | while read -r dir do printf "%s:\t" "$dir"; find "$dir" -type f | wc -l; doneThat should give you the spot where the inodes are used.
Do not start from root, but individually for each top level directory except /proc /run and you can skip the symlinks as well.
-
-
-
You have to check for each directory starting from / not the home directory of user root.
I'd start with /var
-
-
-
-
now df -i
The files in /var/lib reduced quite a bit. Did one of your docker containers run wild?
-
Code
Display More/lib# find . -maxdepth 1 -type d | while read -r dir > do printf "%s:\t" "$dir"; find "$dir" -type f | wc -l; done .: 34958 ./gcc: 0 ./binfmt.d: 0 ./modprobe.d: 3 ./NetworkManager: 1 ./xfsprogs: 2 ./php7.3: 0 ./tasksel: 10 ./ifupdown: 3 ./environment.d: 0 ./cryptsetup: 15 ./udev: 77 ./postfix: 44 ./modules: 18969 ./plexmediaserver: 2832 ./mime: 8 ./grub: 292 ./kernel: 3 ./proftpd: 38 ./pm-utils: 42 ./networkd-dispatcher: 0 ./hdparm: 1 ./init: 2 ./locale: 13 ./python2.7: 1254 ./sysusers.d: 3 ./valgrind: 2 ./firmware: 1957 ./modules-load.d: 0 ./nginx: 10 ./file: 1 ./ssl: 2 ./systemd: 363 ./netplan: 1 ./lsb: 3 ./gnupg: 1 ./dbus-1.0: 1 ./python3.7: 1283 ./tmpfiles.d: 17 ./apt: 15 ./x86_64-linux-gnu: 1951 ./dpkg: 5 ./python3: 5437 ./grub-legacy: 1 ./tc: 6 ./sasl2: 0 ./collectd: 143 ./terminfo: 40 ./openssh: 5 ./sysstat: 4 ./cgi-bin: 1 ./php: 40 ./chrony: 1 ./pkgconfig: 1 ./rsyslog: 1 ./klibc: 37 ./console-setup: 2 ./sudo: 11 -
-
Code
/var# df -i Dateisystem Inodes IBenutzt IFrei IUse% Eingehängt auf udev 2002741 470 2002271 1% /dev tmpfs 2008968 783 2008185 1% /run /dev/sde1 2883584 2883584 0 100% / tmpfs 2008968 1 2008967 1% /dev/shm tmpfs 2008968 3 2008965 1% /run/lock tmpfs 2008968 18 2008950 1% /sys/fs/cgroup tmpfs 2008968 7 2008961 1% /tmp /dev/mapper/Stube-Media 169472000 9313 169462687 1% /srv/dev-disk-by-label-medI don´t know with the docker containers but I think so

-
df -i is not any better. /dev/sde1 is still full
-
what is the different between:
Code
Display Mores:/var# df -i Dateisystem Inodes IBenutzt IFrei IUse% Eingehängt auf udev 2002741 470 2002271 1% /dev tmpfs 2008968 783 2008185 1% /run /dev/sde1 2883584 2883584 0 100% / tmpfs 2008968 1 2008967 1% /dev/shm tmpfs 2008968 3 2008965 1% /run/lock tmpfs 2008968 18 2008950 1% /sys/fs/cgroup tmpfs 2008968 7 2008961 1% /tmp /dev/mapper/Stube-Media 169472000 9313 169462687 1% /srv/dev-disk-by-label-med root@omnas:/var# df -h Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf udev 7,7G 0 7,7G 0% /dev tmpfs 1,6G 162M 1,4G 11% /run /dev/sde1 43G 24G 18G 57% / tmpfs 7,7G 0 7,7G 0% /dev/shm tmpfs 5,0M 0 5,0M 0% /run/lock tmpfs 7,7G 0 7,7G 0% /sys/fs/cgroup tmpfs 7,7G 0 7,7G 0% /tmp /dev/mapper/Stube-Media 5,1T 1,6T 3,5T 32% /srv/dev-disk-by-label-meddf -i sde1 100% inUse df -h sde1 57% inUse
-
-
df -i shows you the number of inodes, df -h shows you free space in a human readable format.
Think of inode as a number for a file or a directory. There is only a limited number of inodes. Once you reached the maximum number you cannot create new files or directories and you get the message "no space left".
You can read auth.log with less /var/log/auth.log
Use arrow keys to move up and down. You exit with "q"
-
is very large the auth.log.
I see all from 01.07. to december, it looks like this:
Code
Display MoreJul 1 00:04:23 omnas systemd-logind[608]: Watching system buttons on /dev/input/event2 (Power Button) Jul 1 00:04:23 omnas systemd-logind[608]: Watching system buttons on /dev/input/event1 (Power Button) Jul 1 00:04:23 omnas systemd-logind[608]: Watching system buttons on /dev/input/event0 (Sleep Button) Jul 1 00:04:23 omnas systemd-logind[608]: New seat seat0. Jul 1 00:04:23 omnas sshd[665]: Server listening on 0.0.0.0 port 22. Jul 1 00:04:23 omnas sshd[665]: Server listening on :: port 22. Jul 1 00:04:42 omnas sshd[1246]: Accepted password for root from 192.168.178.26 port 49801 ssh2 Jul 1 00:04:42 omnas sshd[1246]: pam_unix(sshd:session): session opened for user root by (uid=0) Jul 1 00:06:01 omnas CRON[1596]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:06:01 omnas CRON[1597]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:06:01 omnas CRON[1595]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:06:01 omnas CRON[1597]: pam_unix(cron:session): session closed for user root Jul 1 00:06:01 omnas CRON[1595]: pam_unix(cron:session): session closed for user root Jul 1 00:06:01 omnas CRON[1596]: pam_unix(cron:session): session closed for user root Jul 1 00:07:01 omnas CRON[1663]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:07:01 omnas CRON[1662]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:07:01 omnas CRON[1664]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:07:01 omnas CRON[1662]: pam_unix(cron:session): session closed for user root Jul 1 00:07:01 omnas CRON[1664]: pam_unix(cron:session): session closed for user root Jul 1 00:07:01 omnas CRON[1663]: pam_unix(cron:session): session closed for user root Jul 1 00:08:01 omnas CRON[1746]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:08:01 omnas CRON[1745]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:08:01 omnas CRON[1747]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:08:01 omnas CRON[1745]: pam_unix(cron:session): session closed for user root Jul 1 00:08:01 omnas CRON[1747]: pam_unix(cron:session): session closed for user root Jul 1 00:08:01 omnas CRON[1746]: pam_unix(cron:session): session closed for user root Jul 1 00:09:01 omnas CRON[1827]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:09:01 omnas CRON[1828]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:09:01 omnas CRON[1829]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:09:01 omnas CRON[1830]: pam_unix(cron:session): session opened for user root by (uid=0) Jul 1 00:09:01 omnas CRON[1830]: pam_unix(cron:session): session closed for user root Jul 1 00:09:01 omnas CRON[1829]: pam_unix(cron:session): session closed for user root Jul 1 00:09:01 omnas CRON[1827]: pam_unix(cron:session): session closed for user root Jul 1 00:09:01 omnas CRON[1828]: pam_unix(cron:session): session closed for user rootI have split it in the first rows (july) and the last rows (december)
Code
Display MoreDec 29 11:54:31 omnas systemd-logind[584]: Watching system buttons on /dev/input/event3 (Power Button) Dec 29 11:54:31 omnas systemd-logind[584]: Watching system buttons on /dev/input/event2 (Power Button) Dec 29 11:54:31 omnas systemd-logind[584]: Watching system buttons on /dev/input/event1 (Sleep Button) Dec 29 11:54:31 omnas systemd-logind[584]: Watching system buttons on /dev/input/event0 (LITE-ON Technology USB NetVista Full Width Keyboard.) Dec 29 11:54:31 omnas systemd-logind[584]: New seat seat0. Dec 29 11:54:31 omnas sshd[634]: Server listening on 0.0.0.0 port 22. Dec 29 11:54:31 omnas sshd[634]: Server listening on :: port 22. Dec 29 11:57:01 omnas CRON[1484]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:57:01 omnas CRON[1483]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:57:01 omnas CRON[1485]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:57:01 omnas CRON[1483]: pam_unix(cron:session): session closed for user root Dec 29 11:57:01 omnas CRON[1485]: pam_unix(cron:session): session closed for user root Dec 29 11:57:01 omnas CRON[1484]: pam_unix(cron:session): session closed for user root Dec 29 11:58:01 omnas CRON[1543]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:58:01 omnas CRON[1542]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:58:01 omnas CRON[1544]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:58:01 omnas CRON[1544]: pam_unix(cron:session): session closed for user root Dec 29 11:58:01 omnas CRON[1542]: pam_unix(cron:session): session closed for user root Dec 29 11:58:01 omnas CRON[1543]: pam_unix(cron:session): session closed for user root Dec 29 11:59:01 omnas CRON[1622]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:59:01 omnas CRON[1621]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:59:01 omnas CRON[1623]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 11:59:01 omnas CRON[1621]: pam_unix(cron:session): session closed for user root Dec 29 11:59:01 omnas CRON[1623]: pam_unix(cron:session): session closed for user root Dec 29 11:59:01 omnas CRON[1622]: pam_unix(cron:session): session closed for user root Dec 29 12:00:01 omnas CRON[1753]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 12:00:01 omnas CRON[1754]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 12:00:01 omnas CRON[1755]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 12:00:01 omnas CRON[1756]: pam_unix(cron:session): session opened for user root by (uid=0) Dec 29 12:00:01 omnas CRON[1753]: pam_unix(cron:session): session closed for user root Dec 29 12:00:01 omnas CRON[1755]: pam_unix(cron:session): session closed for user root Dec 29 12:00:01 omnas CRON[1754]: pam_unix(cron:session): session closed for user root Dec 29 12:00:04 omnas CRON[1756]: pam_unix(cron:session): session closed for user root -
Have you considered rotating that log (and perhaps others) weekly with compression and keeping a month or two's worth?
-
-
-
You should not be using anywhere in /var as your Docker storage location. Move that location to a data disk instead.
Participate now!
Don’t have an account yet? Register yourself now and be a part of our community!