Root disk filling up and log2ram - OdroidXU4

Machine Info - ARMBIAN 5.31 stable Debian GNU/Linux 8 (jessie) 4.9.56-odroidxu4

HI
I'm getting messages saying the rootfs is full

EG.

Resource limit matched Service rootfs

Date:Tue, 07 Nov 2017 07:55:55

Action:alert

Host:odroidxu4

Description: space usage 85.1% matches resource limit [space usage>85.0%]

Your faithful employee,

Monit

and

Resource limit succeeded Service rootfs

Date:Tue, 07 Nov 2017 08:01:31

Action:alert

Host:odroidxu4

Description: filesystem resources succeeded

Your faithful employee,

Monit

Now I think the log2ram maybe be the problem - get these every day, varying is size
I'm not sure if the logs get written to the flash drive first and then moved to ram, which would defeat the whole "not writing to flash"

EG

/etc/cron.daily/log2ram:

sending incremental file list

./

auth.log

auth.log.1

auth.log.2.gz

auth.log.3.gz

auth.log.4.gz

daemon.log

daemon.log.1

daemon.log.2.gz

daemon.log.3.gz

daemon.log.4.gz

debug

debug.1

debug.2.gz

debug.3.gz

debug.4.gz

kern.log

kern.log.1

kern.log.2.gz

kern.log.3.gz

kern.log.4.gz

mail.info

mail.info.1

mail.info.2.gz

mail.info.3.gz

mail.info.4.gz

mail.log

mail.log.1

mail.log.2.gz

mail.log.3.gz

mail.log.4.gz

messages

messages.1

messages.2.gz

messages.3.gz

messages.4.gz

php5-fpm.log

php5-fpm.log.1

php5-fpm.log.10.gz

php5-fpm.log.11.gz

php5-fpm.log.12.gz

php5-fpm.log.2.gz

php5-fpm.log.3.gz

php5-fpm.log.4.gz

php5-fpm.log.5.gz

php5-fpm.log.6.gz

php5-fpm.log.7.gz

php5-fpm.log.8.gz

php5-fpm.log.9.gz

rsync.log

rsync.log.1.gz

rsync.log.2.gz

rsync.log.3.gz

rsync.log.4.gz

syslog

syslog.1

syslog.2.gz

syslog.3.gz

syslog.4.gz

syslog.5.gz

syslog.6.gz

syslog.7.gz

urbackup.log

urbackup.log.1.gz

urbackup.log.2.gz

urbackup.log.3.gz

urbackup.log.4.gz

urbackup.log.5.gz

urbackup.log.6.gz

urbackup.log.7.gz

urbackup.log.8.gz

urbackup.log.9.gz

user.log

user.log.1

user.log.2.gz

user.log.3.gz

user.log.4.gz

cron-apt/

cron-apt/log

cron-apt/log.1.gz

cron-apt/log.2.gz

cron-apt/log.3.gz

cron-apt/log.4.gz

nginx/

nginx/openmediavault-webgui_access.log

nginx/openmediavault-webgui_access.log.1

nginx/openmediavault-webgui_access.log.10.gz

nginx/openmediavault-webgui_access.log.11.gz

nginx/openmediavault-webgui_access.log.12.gz

nginx/openmediavault-webgui_access.log.13.gz

nginx/openmediavault-webgui_access.log.14.gz

nginx/openmediavault-webgui_access.log.2.gz

nginx/openmediavault-webgui_access.log.3.gz

nginx/openmediavault-webgui_access.log.4.gz

nginx/openmediavault-webgui_access.log.5.gz

nginx/openmediavault-webgui_access.log.6.gz

nginx/openmediavault-webgui_access.log.7.gz

nginx/openmediavault-webgui_access.log.8.gz

nginx/openmediavault-webgui_access.log.9.gz

proftpd/

proftpd/proftpd.log

proftpd/proftpd.log.1

proftpd/proftpd.log.2.gz

proftpd/proftpd.log.3.gz

proftpd/proftpd.log.4.gz

proftpd/proftpd.log.5.gz

proftpd/proftpd.log.6.gz

proftpd/proftpd.log.7.gz

samba/

samba/log.nmbd

samba/log.nmbd.1.gz

samba/log.nmbd.2.gz

samba/log.nmbd.3.gz

samba/log.nmbd.4.gz

samba/log.nmbd.5.gz

samba/log.nmbd.6.gz

samba/log.nmbd.7.gz

samba/log.smbd

samba/log.smbd.1.gz

samba/log.smbd.2.gz

samba/log.smbd.3.gz

samba/log.smbd.4.gz

samba/log.smbd.5.gz

samba/log.smbd.6.gz

samba/log.smbd.7.gz

unattended-upgrades/unattended-upgrades.log

sent 8,242,848 bytesreceived 2,356 bytes1,268,492.92 bytes/sec total size is 9,150,972speedup is 1.11

Disk space report below

Welcome to ARMBIAN 5.31 stable Debian GNU/Linux 8 (jessie) 4.9.56-odroidxu4
System load: 0.23 0.25 0.22 Up time: 1 day
Memory usage: 10 % of 1993MB IP: 192.168.1.231
CPU temp: 61°C
Usage of /: 84% of 3.7G storage/: 1% of 917G

[ 0 security updates available, 2 updates total: apt upgrade ]
Last check: 2017-11-07 00:00
[ General system configuration: armbian-config ]
Last login: Fri Nov 3 09:18:01 2017

root@odroidxu4:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 0 10M 0% /dev
tmpfs 399M 17M 382M 5% /run
/dev/mmcblk1p1 3.7G 3.0G 608M 84% /
tmpfs 997M 0 997M 0% /dev/shm
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 997M 0 997M 0% /sys/fs/cgroup
tmpfs 997M 0 997M 0% /tmp
/dev/sda1 917G 72M 871G 1% /srv/dev-disk-by-label-1TB
/dev/sdb1 3.6T 2.5T 1.1T 70% /srv/dev-disk-by-label-Tank4Gb
folder2ram 997M 8.2M 989M 1% /var/log
folder2ram 997M 0 997M 0% /var/tmp
folder2ram 997M 324K 997M 1% /var/lib/openmediavault/rrd
folder2ram 997M 1.4M 996M 1% /var/spool
folder2ram 997M 14M 984M 2% /var/lib/rrdcached
folder2ram 997M 8.0K 997M 1% /var/lib/monit
folder2ram 997M 4.0K 997M 1% /var/lib/php5
folder2ram 997M 0 997M 0% /var/lib/netatalk/CNID
folder2ram 997M 464K 997M 1% /var/cache/samba
tmpfs 200M 0 200M 0% /run/user/0

Any thoughts on whats going wrong, do I need to increase the root / partition, its on a 16GB micro SD card.

Thanks

Leigh

Hi tkaiser

First - sorry for not replying so soon, work load has been hectic and first time to look at this

Tried the above resize and it did not work - tried 3 or 4 time with reboots between.

So put the card in a Linux laptop (Mint 17) and disk utility shows 2 partitions, both Unknown type !
First is 4GB in size the other 11GB and 310mb at the end free.

So what should the partitions be EXT3,EXT4, ?

Also tried dd command to make an image and get IO errors at around 105MB

Card in the odroid appear to boot fine with no fsck errors

Before I wipe the card clean and do a fresh install - any ideas ?

Hmm - turns out that the SD card reader is faulty
For some reason I tried the sd card in a SD/USB adapter, plugged it into the USB port and 4GB Ext4 partition was view able.
So deleted the 11GB Unknown one, ran resize2fs as above, reboot and now have 15GB partition.

So the one last question, whats the /etc/cron.daily/log2ram: actually do ?
"sending incremental file list" from where ?

Is it moving files from SD card to RAM every time ?

Leigh

Thanks - will do