The Moby Project - a collaborative project for the container ecosystem to assemble container-based systems
Find a file
Kir Kolyshkin 57f06409b1 aufs: retry unmount on EBUSY
For some reason, retrying to unmount in case of getting EBUSY error
was only performed in Remove(), but not Put().

I have done some testing on Ubuntu 16.04 and 18.04 with aufs,
performing massively parallel container creation using this script:

```
NUMCTS=5000
PARALLEL=100
IMAGE=busybox

docker pull $IMAGE >/dev/null
seq $NUMCTS | parallel -j$PARALLEL docker create $IMAGE true > /dev/null
docker ps -qa | shuf | tail -n $NUMCTS | parallel -j$PARALLEL docker rm -f '{}' > /dev/null
```

Sometimes (1 to 5 times per 10000 `docker create`), aufs.Put() fails on Unmount syscall
with EBUSY during container creation:

> Error response from daemon: device or resource busy

and in docker log, with debug turned on:

> level=debug msg="Failed to unmount ID-init aufs: device or resource busy"
> level=error msg="Handler for POST /v1.30/containers/create returned error: device or resource busy"

I did some debugging by running fuser -v -M -m $MOUNT_POINT but
that reveals nothing.

This commit:

 * implements retry on EBUSY in Unmount()
 * calls Unmount() from Remove()
 * increases the number of retries from 3 to 5

Signed-off-by: Kir Kolyshkin <kolyshkin@gmail.com>
2019-05-28 18:54:44 -07:00
.github Remove myself from codeowners 😅 2019-01-10 17:32:26 +01:00
api API: Change type of RemotrAddrs to array of strings in operation SwarmJoin 2019-05-23 15:14:34 +02:00
builder builder-next: support DOCKER_RAMDISK 2019-05-22 00:39:03 +09:00
cli allow running dockerd in an unprivileged user namespace (rootless mode) 2019-02-04 00:24:27 +09:00
client client: do not fallback to GET if HEAD on _ping fail to connect 2019-05-13 13:48:17 +01:00
cmd/dockerd Merge pull request #39105 from cpuguy83/optimize_test_daemon_startup 2019-05-23 11:58:47 -07:00
container Remove DiskQouta field. 2019-04-30 15:13:08 +07:00
contrib dockerd-rootless.sh: use exec 2019-05-15 20:52:59 +09:00
daemon aufs: retry unmount on EBUSY 2019-05-28 18:54:44 -07:00
distribution *: remove interfacer linter from CI 2019-03-13 11:48:39 +11:00
dockerversion Remove version-checks for containerd and runc 2018-10-04 23:17:13 +02:00
docs Move CgroupnsMode feature to API v1.41 2019-05-13 15:04:28 -07:00
errdefs errdefs: remove "ErrAlreadyExists" because it's not an error 2019-03-21 21:25:15 +00:00
hack bump libnetwork 5ac07abef4eee176423fdc1b870d435258e2d381 2019-05-21 14:46:18 +02:00
image Merge pull request #38888 from quasilyte/fix_copying 2019-03-21 01:48:27 +01:00
integration Merge pull request #38377 from rgulewich/38332-cgroup-ns 2019-05-11 20:18:31 -07:00
integration-cli Merge pull request #39254 from thaJeztah/update_seccomp_test_for_aarch64 2019-05-23 11:23:14 -07:00
internal Merge pull request #39105 from cpuguy83/optimize_test_daemon_startup 2019-05-23 11:58:47 -07:00
layer layer: optimize layerStore mountL 2019-05-09 11:05:16 -07:00
libcontainerd Remove inmemory container map 2019-04-05 15:48:07 -04:00
oci Capabilities refactor 2019-01-22 21:50:41 +02:00
opts dockerd: fix rootless detection (alternative to #39024) 2019-04-25 16:47:01 +09:00
pkg Merge pull request #38992 from kolyshkin/mnt 2019-05-20 14:12:42 +02:00
plugin Remove inmemory container map 2019-04-05 15:48:07 -04:00
profiles seccomp: whitelist io_pgetevents() 2019-03-18 20:46:16 +02:00
project Add support for setting GOARM in cross target. 2019-04-17 13:19:14 -07:00
reference Merge pull request #37781 from mtrmac/reference-race-upstream 2018-10-18 12:35:57 -07:00
registry *: remove interfacer linter from CI 2019-03-13 11:48:39 +11:00
reports Fix typos 2018-05-16 09:15:43 +08:00
restartmanager Add canonical import comment 2018-02-05 16:51:57 -05:00
rootless dockerd: fix rootless detection (alternative to #39024) 2019-04-25 16:47:01 +09:00
runconfig Make cgroup namespaces configurable 2019-05-07 10:22:16 -07:00
vendor bump libnetwork 5ac07abef4eee176423fdc1b870d435258e2d381 2019-05-21 14:46:18 +02:00
volume Fix error handling for bind mount spec parser. 2019-05-22 11:54:26 -07:00
.DEREK.yml Update .DEREK.yml 2019-05-06 13:27:04 -07:00
.dockerignore [EXPERIMENTAL] Integration Test on Swarm 2017-02-28 02:10:09 +00:00
.gitignore Add code coverage report and codecov config 2018-01-16 16:50:56 -05:00
.mailmap Update AUTHORS and mailmap 2019-04-27 16:50:47 -07:00
AUTHORS Update AUTHORS and mailmap 2019-04-27 16:50:47 -07:00
CHANGELOG.md Fix some typos 2018-09-07 13:13:47 +08:00
codecov.yml Add code coverage report and codecov config 2018-01-16 16:50:56 -05:00
CONTRIBUTING.md Fix link anchors in CONTRIBUTING.md 2018-06-13 21:58:48 +09:00
Dockerfile Bump Golang 1.12.5 2019-05-07 11:19:39 +08:00
Dockerfile.e2e Bump Golang 1.12.5 2019-05-07 11:19:39 +08:00
Dockerfile.simple Bump Golang 1.12.5 2019-05-07 11:19:39 +08:00
Dockerfile.windows Bump Golang 1.12.5 2019-05-07 11:19:39 +08:00
Jenkinsfile Add Jenkinsfile 2019-02-26 20:03:29 +00:00
LICENSE Update LICENSE 2018-09-12 14:27:53 +01:00
MAINTAINERS MAINTAINERS: update Akihiro Suda's email address 2019-04-17 18:26:21 +09:00
Makefile Fix DOCKER_CROSS being overwritten 2019-04-15 18:37:56 +02:00
NOTICE Update LICENSE date 2017-02-15 17:34:33 +01:00
poule.yml Poule:Add Windows RS5 2018-10-08 15:38:27 -07:00
README.md Add "Lego set" back in README.md 2017-10-10 14:10:39 +00:00
ROADMAP.md Fix some typos in ROADMAP.md 2019-01-25 14:27:13 +08:00
TESTING.md Merge pull request #37249 from AntaresS/add-test-guidline 2018-06-25 20:44:42 +02:00
vendor.conf bump libnetwork 5ac07abef4eee176423fdc1b870d435258e2d381 2019-05-21 14:46:18 +02:00
VENDORING.md fix the bare url and the Summary of http://semver.org 2017-01-17 16:20:11 +08:00

The Moby Project

Moby Project logo

Moby is an open-source project created by Docker to enable and accelerate software containerization.

It provides a "Lego set" of toolkit components, the framework for assembling them into custom container-based systems, and a place for all container enthusiasts and professionals to experiment and exchange ideas. Components include container build tools, a container registry, orchestration tools, a runtime and more, and these can be used as building blocks in conjunction with other tools and projects.

Principles

Moby is an open project guided by strong principles, aiming to be modular, flexible and without too strong an opinion on user experience. It is open to the community to help set its direction.

  • Modular: the project includes lots of components that have well-defined functions and APIs that work together.
  • Batteries included but swappable: Moby includes enough components to build fully featured container system, but its modular architecture ensures that most of the components can be swapped by different implementations.
  • Usable security: Moby provides secure defaults without compromising usability.
  • Developer focused: The APIs are intended to be functional and useful to build powerful tools. They are not necessarily intended as end user tools but as components aimed at developers. Documentation and UX is aimed at developers not end users.

Audience

The Moby Project is intended for engineers, integrators and enthusiasts looking to modify, hack, fix, experiment, invent and build systems based on containers. It is not for people looking for a commercially supported system, but for people who want to work and learn with open source code.

Relationship with Docker

The components and tools in the Moby Project are initially the open source components that Docker and the community have built for the Docker Project. New projects can be added if they fit with the community goals. Docker is committed to using Moby as the upstream for the Docker Product. However, other projects are also encouraged to use Moby as an upstream, and to reuse the components in diverse ways, and all these uses will be treated in the same way. External maintainers and contributors are welcomed.

The Moby project is not intended as a location for support or feature requests for Docker products, but as a place for contributors to work on open source code, fix bugs, and make the code more useful. The releases are supported by the maintainers, community and users, on a best efforts basis only, and are not intended for customers who want enterprise or commercial support; Docker EE is the appropriate product for these use cases.


Legal

Brought to you courtesy of our legal counsel. For more context, please see the NOTICE document in this repo.

Use and transfer of Moby may be subject to certain restrictions by the United States and other governments.

It is your responsibility to ensure that your use and/or transfer does not violate applicable laws.

For more information, please see https://www.bis.doc.gov

Licensing

Moby is licensed under the Apache License, Version 2.0. See LICENSE for the full license text.