How to deal with full system disk? Cannot login to web GUI only

  • I have found similar issues from the forum, but I'm not sure about the solution. I can ssh to my box, 1 directory is 100% full. I have no idea how to clean up, which I assume is the solution so that i can access GUI again. Here are some stats. Thanks in advance.


    I edited and what I see is the /var/lib/docker/overlay2/* is growing with many files a day. I have no idea what this is.


    root@omv4:/etc# df -hx --max-depth=1 /
    Filesystem Size Used Avail Use% Mounted on
    /dev/sda1 47G 47G 0 100% /


    root@omv4:~# df -h
    Filesystem Size Used Avail Use% Mounted on
    udev 3.9G 0 3.9G 0% /dev
    tmpfs 791M 9.3M 782M 2% /run
    /dev/sda1 47G 47G 0 100% /
    tmpfs 3.9G 0 3.9G 0% /dev/shm
    tmpfs 5.0M 0 5.0M 0% /run/lock
    tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
    tmpfs 3.9G 0 3.9G 0% /tmp
    West:East500:General3 4.6T 52G 4.6T 2% /srv/856d8063-215e-4188-aa10-08d5bb74f6a7
    /dev/sdd1 3.6T 12G 3.6T 1% /srv/dev-disk-by-label-General3
    /dev/sdb1 586G 41G 546G 7% /srv/dev-disk-by-label-East500
    /dev/sdc1 458G 73M 458G 1% /srv/dev-disk-by-label-West
    overlay 47G 47G 0 100% /var/lib/docker/overlay2/1e29c41a26504c517fb1fadd9f0d8c4d3b9a5c0db646139886d1f6f3c46287b6/merged
    overlay 47G 47G 0 100% /var/lib/docker/overlay2/efd5d14e3239a070934d16a04c102323de838eb5cb18d0d69679d6def1b411fb/merged
    overlay 47G 47G 0 100% /var/lib/docker/overlay2/64f330bc22a89d90138a194940aef5dcce7aa084caea52b40678d15dfda2972f/merged
    overlay 47G 47G 0 100% /var/lib/docker/overlay2/4951a8853d4bacb8bde1a2d7ac3b7bcefd6f8e1758fc88ac326ed1886a4e5c8f/merged


    overlay 47G 47G 0 100% /var/lib/docker/overlay2/a3e154fa356f17081c9ece789633ab40ce506aa993f29b01af3e9c29e178a4d7/merged

  • So with extra searching, I ran one command:


    docker system prune -a -f


    And that began to delete some of the files:


    /dev/sda1 47G 41G 4.6G 90% /
    /dev/sda1 47G 32G 14G 70% /
    /dev/sda1 47G 30G 16G 66% /
    /dev/sda1 47G 25G 20G 56% /
    /dev/sda1 47G 20G 26G 44% /
    /dev/sda1 47G 15G 30G 34% /
    /dev/sda1 47G 14G 32G 31% /


    I don't know what these files are, but this seems to be the key!


    I am able to reach the GUI!

  • Furthermore, I have found that this issue with /var/lib/docker/overlay2/* is due to docker and is a normal process..



    According to this "tips and tricks" link, here, there is a cleanup that needs to be done daily to " will remove all stopped containers, all unused networks, all dangling images and build caches."


    We will run:
    crontab -e


    insert this:



    0 3 * * * /usr/bin/docker system prune -f

  • better if add the crontab in webGUI, to avoid loss on reboot & updates.

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!