Clearing docker disk space to reclaim

docker pull & docker build creates new docker images. Each layer is cached &  uses aufs, so it decreases disk usage by itself, but it’s also leaving previous versions / layers dangling.

We can remove untagged images by running:

docker images –no-trunc | grep ‘<none>’ | awk ‘{ print $3 }’  | xargs -r docker rmi

docker run leaves the container by default. This is convenient if you’d like to review the process later — look at the logs or exit status. This also stores the aufs filesystem changes, so you can commit the container as a new image.

This can be expensive in terms of disk space usage, especially during testing. Remember to use docker run –rm flag if you don’t need to inspect the container later. This flag doesn’t work with background containers (-d), so you’ll be left with finished containers anyway. Clean up dead and exited containers using command:

docker ps –filter status=dead –filter status=exited -aq \ | xargs docker rm -v

docker rm does not remove the volumes created by the container. I can’t figure out why would the default be this way, but you need to use the -v flag to remove the volumes along the container.

Docker filesystem storage and volumes

There are three main ways docker stores files:

By default, everything you save to disk inside the container is saved in the aufs layer. This doesn’t create problems if you clean up unused containers and images.
If you mount a file or directory from the host (using docker run -v /host/path:/container/path …) the files are stored in the host filesystem, so it’s easy to track them and there is no problem also.
The third way are docker volumes. Those are special paths that are mapped to a special directory in /var/lib/docker/volumes/ path on the host. A lot of images use volumes to share files between containers (using the volumes-from option) or persist data so you won’t lose them after the process exits (the data-only containers pattern).
Now, since there is no tool to list volumes and their state, it’s easy to leave them on disk even after all processes exited and all containers are removed. The following command inspects all containers (running or not) and compares them to created volumes, printing only the paths that are not referenced by any container:

#!/usr/bin/env bash

find ‘/var/lib/docker/volumes/’ -mindepth 1 -maxdepth 1 -type d | grep -vFf <(
docker ps -aq | xargs docker inspect | jq -r ‘.[]|.Mounts|.[]|.Name|select(.)’
)

What it does, step by step:

List all created volumes
List all containers and inspect them, creating a JSON array with all the entries
Format the output using jq to get all the names of every mounted volume
Exclude (grep -vFf) mounted volumes form the list of all volumes
You need to run this as root and have jq utility present.

The command doesn’t remove anything, but simply passing the results to xargs -r rm -fr does so.

docker volume ls -qf dangling=true | xargs -r docker volume rm
Recap

Save the following script to clean up everything at once:

#!/bin/bash

# remove exited containers:
docker ps –filter status=dead –filter status=exited -aq | xargs -r docker rm -v

# remove unused images:
docker images –no-trunc | grep ‘<none>’ | awk ‘{ print $3 }’ | xargs -r docker rmi

# remove unused volumes:
find ‘/var/lib/docker/volumes/’ -mindepth 1 -maxdepth 1 -type d | grep -vFf <(
docker ps -aq | xargs docker inspect | jq -r ‘.[] | .Mounts | .[] | .Name | select(.)’
) | xargs -r rm -fr

useful docker cleanup commands

docker ps -a | grep “Exit” | awk ‘{print $1}’ | xargs -I{} docker stop {}

docker ps -a | grep “Exit” | awk ‘{print $1}’ | xargs -I{}

docker kill {} docker ps -a | grep “Exit” | awk ‘{print $1}’ | xargs -I{}

docker rm {} docker images | grep “<none>” | awk ‘{print $3}’ | xargs docker rmi

One Reply to “Clearing docker disk space to reclaim”

Leave a Reply

Your email address will not be published. Required fields are marked *