Go to file
Evan Hazlett 1537f31381 Add install support for binary images
This adds a way for users to programatically install containerd binary
dependencies.

With runtime v2 and new shim's being built, it will be a challenge to
get those onto machines.  Users would have to find the link, download,
place it in their path, yada yada yada.

With this functionality of a managed `/opt` directory, containerd can
use existing image and distribution infra. to get binarys, shims, etc
onto the system.

Configuration:

*default:* `/opt/containerd`

*containerd config:*
```toml
[plugins.opt]
	path = "/opt/mypath"

```

Usage:

*code:*

```go
image, err := client.Pull(ctx, "docker.io/crosbymichael/runc:latest")
client.Install(ctx, image)
```

*ctr:*

```bash
ctr content fetch docker.io/crosbymichael/runc:latest
ctr install docker.io/crosbymichael/runc:latest
```

You can manage versions and see what is running via standard image
commands.

Images:

These images MUST be small and only contain binaries.

```Dockerfile
FROM scratch
Add runc /bin/runc
```

Containerd will only extract files in `/bin` of the image.

Later on, we can add support for `/lib`.

The code adds a service to manage an `/opt/containerd` directory and
provide that path to callers via the introspection service.

How to Test:

Delete runc from your system.

```bash
> sudo ctr run --rm  docker.io/library/redis:alpine redis
ctr: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/containerd/io.containerd.runtime.v1.linux/default/redis/log.json: no such file or directory): exec: "runc": executable file not found in $PATH: unknown

> sudo ctr content fetch docker.io/crosbymichael/runc:latest
> sudo ctr  install docker.io/crosbymichael/runc:latest

> sudo ctr run --rm  docker.io/library/redis:alpine redis
1:C 01 Aug 15:59:52.864 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 01 Aug 15:59:52.864 # Redis version=4.0.10, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 01 Aug 15:59:52.864 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
1:M 01 Aug 15:59:52.866 # You requested maxclients of 10000 requiring at least 10032 max file descriptors.
1:M 01 Aug 15:59:52.866 # Server can't set maximum open files to 10032 because of OS error: Operation not permitted.
1:M 01 Aug 15:59:52.866 # Current maximum open files is 1024. maxclients has been reduced to 992 to compensate for low ulimit. If you need higher maxclients increase 'ulimit -n'.
1:M 01 Aug 15:59:52.870 * Running mode=standalone, port=6379.
1:M 01 Aug 15:59:52.870 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
1:M 01 Aug 15:59:52.870 # Server initialized
1:M 01 Aug 15:59:52.870 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
1:M 01 Aug 15:59:52.870 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
1:M 01 Aug 15:59:52.870 * Ready to accept connections
^C1:signal-handler (1533139193) Received SIGINT scheduling shutdown...
1:M 01 Aug 15:59:53.472 # User requested shutdown...
1:M 01 Aug 15:59:53.472 * Saving the final RDB snapshot before exiting.
1:M 01 Aug 15:59:53.484 * DB saved on disk
1:M 01 Aug 15:59:53.484 # Redis is now ready to exit, bye bye...
```

Signed-off-by: Evan Hazlett <ejhazlett@gmail.com>
Signed-off-by: Michael Crosby <crosbymichael@gmail.com>
2018-08-02 17:11:29 -04:00
.github Add github issue template 2018-01-17 11:11:53 -05:00
api Merge pull request #2493 from dmcgowan/sync-lease-removal 2018-07-31 11:31:55 -04:00
archive Add install support for binary images 2018-08-02 17:11:29 -04:00
cio IO Windows remove unused wait group 2018-08-01 09:54:31 -07:00
cmd Add install support for binary images 2018-08-02 17:11:29 -04:00
containers Licence header added 2018-02-19 10:32:26 +09:00
content Add content ingests to lease and gc 2018-07-25 16:54:14 -07:00
contrib Merge pull request #2512 from crosbymichael/gpupath 2018-07-31 09:28:33 -07:00
defaults fix words misspell 2018-04-23 00:09:42 -04:00
design Remove outdated plugin design doc 2018-07-25 23:28:09 -07:00
diff Switching from crypto/rand to math/rand to avoid blocking 2018-07-11 16:24:51 -04:00
docs Document how to use systemd-run 2018-06-27 16:58:30 +02:00
errdefs Licence header added 2018-02-19 10:32:26 +09:00
events Licence header added 2018-02-19 10:32:26 +09:00
filters fix words misspell 2018-04-23 00:09:42 -04:00
gc Update tests to use gotest.tools angel 2018-06-08 21:02:01 +02:00
identifiers Licence header added 2018-02-19 10:32:26 +09:00
images oci-exporter: do not filter current platform on export 2018-07-13 17:08:01 -07:00
labels Licence header added 2018-02-19 10:32:26 +09:00
leases Update lease service errors 2018-07-25 14:56:35 -07:00
log Set default log formatting to use RFC3339Nano with fixed width 2018-07-24 10:23:38 +02:00
metadata Merge pull request #2493 from dmcgowan/sync-lease-removal 2018-07-31 11:31:55 -04:00
metrics/cgroups Merge pull request #2471 from crosbymichael/fatal 2018-07-23 14:17:57 -07:00
mount Don't prevent boot on temp cleanup 2018-07-13 16:07:17 -04:00
namespaces Switch from x/net/context to context 2018-04-24 14:33:34 -07:00
oci Merge pull request #2479 from stevvooe/with-file-combinator 2018-07-27 15:56:53 -07:00
pkg Seed random on ctr and containerd startup 2018-07-12 17:51:55 -07:00
platforms Normalize arm64 to an empty variant 2018-06-23 16:35:46 -07:00
plugin Runtime v2 2018-07-17 10:21:29 -04:00
protobuf/plugin protobuf: remove generated google/rpc files 2018-04-05 14:36:32 -07:00
reference Licence header added 2018-02-19 10:32:26 +09:00
releases Prepare 1.1.0 release 2018-04-23 18:29:33 -07:00
remotes Merge pull request #2263 from alibaba/fix_no_gzip 2018-07-30 18:49:28 -04:00
reports Fix sublist in dev report 2017-06-26 10:58:05 -07:00
rootfs Switching from crypto/rand to math/rand to avoid blocking 2018-07-11 16:24:51 -04:00
runtime Adds retry support to Windows AnonDialer 2018-08-01 13:22:25 -07:00
script Update cri plugin to v1.0.0. 2018-04-23 16:34:17 -07:00
services Add install support for binary images 2018-08-02 17:11:29 -04:00
snapshots native: set '/' permission to 0755 2018-07-23 16:14:55 +09:00
sys Runtime v2 2018-07-17 10:21:29 -04:00
vendor Update containerd dependencies for 1.2 2018-07-26 15:00:59 -04:00
version Prepare 1.1.0 release 2018-04-23 18:29:33 -07:00
windows Fix compilation failures on Go 1.11 2018-07-23 20:01:56 +02:00
.appveyor.yml build: bump to Go 1.10 2018-02-26 16:47:24 -08:00
.gitignore Add capability to build manpages from markdown 2018-01-30 19:50:45 -05:00
.gometalinter.json Add unconvert linter 2018-01-09 17:36:44 -05:00
.travis.yml Fix loss of CRI test failure status in CI 2018-08-01 13:54:16 -04:00
benchmark_test.go Licence header added 2018-02-19 10:32:26 +09:00
BUILDING.md BUILDING.md: add osusergo for static build 2018-07-19 12:32:15 +03:00
client_opts.go Ensure specifying an empty platform is treated as default 2018-07-31 15:08:59 -07:00
client_test.go Update multi-arch image tests 2018-08-01 11:22:07 -07:00
client_unix_test.go Licence header added 2018-02-19 10:32:26 +09:00
client_windows_test.go Licence header added 2018-02-19 10:32:26 +09:00
client.go Use image constructor in client 2018-07-31 15:23:08 -07:00
code-of-conduct.md Add code of conduct 2017-04-04 09:41:38 -07:00
container_checkpoint_test.go Runtime v2 2018-07-17 10:21:29 -04:00
container_linux_test.go Runtime v2 2018-07-17 10:21:29 -04:00
container_opts_unix.go content: change Writer/ReaderAt to take OCI 2018-06-01 11:51:43 +09:00
container_opts.go oci: introduce WithSpecFromFile combinator 2018-07-27 14:25:42 -07:00
container_test.go Runtime v2 2018-07-17 10:21:29 -04:00
container.go Use image constructor in client 2018-07-31 15:23:08 -07:00
containerd.service Add rlimits to service file 2017-11-30 18:50:32 -05:00
containerstore.go Add containers streaming API 2018-07-26 13:55:20 -04:00
content_test.go Pass in context to lease done function in client 2018-03-22 14:09:24 -07:00
CONTRIBUTING.md Adds note about applying license header 2018-03-08 10:47:38 +09:00
daemon_config_linux_test.go Runtime v2 2018-07-17 10:21:29 -04:00
daemon_test.go linux: fix runtime-root propagation 2018-03-05 15:01:22 +09:00
diff.go Add service plugin and support in process integration. 2018-03-12 18:03:50 +00:00
events.go Add service plugin and support in process integration. 2018-03-12 18:03:50 +00:00
export_test.go Update client Image to have configurable platform 2018-07-17 15:43:03 -07:00
grpc.go Switch from x/net/context to context 2018-04-24 14:33:34 -07:00
helpers_unix_test.go Licence header added 2018-02-19 10:32:26 +09:00
helpers_windows_test.go Licence header added 2018-02-19 10:32:26 +09:00
image_store.go Licence header added 2018-02-19 10:32:26 +09:00
image_test.go Update multi-arch image tests 2018-08-01 11:22:07 -07:00
image.go Update client Image to have configurable platform 2018-07-17 15:43:03 -07:00
import_test.go Update client Image to have configurable platform 2018-07-17 15:43:03 -07:00
import.go Use image constructor in client 2018-07-31 15:23:08 -07:00
install.go Add install support for binary images 2018-08-02 17:11:29 -04:00
lease.go Add leases manager interface 2018-07-18 10:43:37 -07:00
LICENSE Edit Containerd license info so GitHub recognizes it 2018-04-02 12:31:15 -07:00
MAINTAINERS Update adding maintainer section 2018-06-07 16:05:57 -07:00
Makefile Runtime v2 2018-07-17 10:21:29 -04:00
Makefile.darwin Licence header added 2018-02-19 10:32:26 +09:00
Makefile.freebsd Licence header added 2018-02-19 10:32:26 +09:00
Makefile.linux Runtime v2 2018-07-17 10:21:29 -04:00
Makefile.windows Adds runtime v2 support for Windows shim's 2018-07-25 14:09:26 -07:00
namespaces.go Licence header added 2018-02-19 10:32:26 +09:00
NOTICE Update readme and documentation for release 2015-12-16 12:15:22 -08:00
PLUGINS.md Document plugins 2018-07-25 23:28:09 -07:00
process.go fix words misspell 2018-04-23 00:09:42 -04:00
Protobuild.toml Fixes for runtimev2 and checkpoint restore 2018-07-20 12:09:29 -04:00
README.md Merge pull request #2480 from dmcgowan/proxy-plugin-doc 2018-07-30 11:23:24 -07:00
RELEASES.md Prepare 1.1.0 release 2018-04-23 18:29:33 -07:00
ROADMAP.md Update roadmap.md with issue labels and milestones 2018-01-04 10:47:06 -05:00
RUNC.md fix RUNC.md vs vendor.conf mismatch 2018-05-11 13:56:54 +09:00
SCOPE.md Update readme 2017-06-20 13:19:53 -07:00
services.go Add leases manager interface 2018-07-18 10:43:37 -07:00
snapshot_test.go Licence header added 2018-02-19 10:32:26 +09:00
snapshotter_default_linux.go Licence header added 2018-02-19 10:32:26 +09:00
snapshotter_default_unix.go enable native (formerly naive) snapshotter by default 2018-04-02 13:29:19 +09:00
snapshotter_default_windows.go Licence header added 2018-02-19 10:32:26 +09:00
task_opts_linux_test.go linux -> runtime/linux 2018-05-30 09:23:10 -04:00
task_opts_linux.go linux -> runtime/linux 2018-05-30 09:23:10 -04:00
task_opts_windows.go Licence header added 2018-02-19 10:32:26 +09:00
task_opts.go Runtime v2 2018-07-17 10:21:29 -04:00
task.go Use image constructor in client 2018-07-31 15:23:08 -07:00
vendor.conf Update containerd dependencies for 1.2 2018-07-26 15:00:59 -04:00

banner

GoDoc Build Status FOSSA Status Go Report Card CII Best Practices

containerd is an industry-standard container runtime with an emphasis on simplicity, robustness and portability. It is available as a daemon for Linux and Windows, which can manage the complete container lifecycle of its host system: image transfer and storage, container execution and supervision, low-level storage and network attachments, etc.

containerd is designed to be embedded into a larger system, rather than being used directly by developers or end-users.

architecture

Getting Started

See our documentation on containerd.io:

See how to build containerd from source at BUILDING.

If you are interested in trying out containerd see our example at Getting Started.

Runtime Requirements

Runtime requirements for containerd are very minimal. Most interactions with the Linux and Windows container feature sets are handled via runc and/or OS-specific libraries (e.g. hcsshim for Microsoft). The current required version of runc is always listed in RUNC.md.

There are specific features used by containerd core code and snapshotters that will require a minimum kernel version on Linux. With the understood caveat of distro kernel versioning, a reasonable starting point for Linux is a minimum 4.x kernel version.

The overlay filesystem snapshotter, used by default, uses features that were finalized in the 4.x kernel series. If you choose to use btrfs, there may be more flexibility in kernel version (minimum recommended is 3.18), but will require the btrfs kernel module and btrfs tools to be installed on your Linux distribution.

To use Linux checkpoint and restore features, you will need criu installed on your system. See more details in Checkpoint and Restore.

Build requirements for developers are listed in BUILDING.

Features

Client

containerd offers a full client package to help you integrate containerd into your platform.


import (
  "github.com/containerd/containerd"
  "github.com/containerd/containerd/cio"
)


func main() {
	client, err := containerd.New("/run/containerd/containerd.sock")
	defer client.Close()
}

Namespaces

Namespaces allow multiple consumers to use the same containerd without conflicting with each other. It has the benefit of sharing content but still having separation with containers and images.

To set a namespace for requests to the API:

context = context.Background()
// create a context for docker
docker = namespaces.WithNamespace(context, "docker")

containerd, err := client.NewContainer(docker, "id")

To set a default namespace on the client:

client, err := containerd.New(address, containerd.WithDefaultNamespace("docker"))

Distribution

// pull an image
image, err := client.Pull(context, "docker.io/library/redis:latest")

// push an image
err := client.Push(context, "docker.io/library/redis:latest", image.Target())

Containers

In containerd, a container is a metadata object. Resources such as an OCI runtime specification, image, root filesystem, and other metadata can be attached to a container.

redis, err := client.NewContainer(context, "redis-master")
defer redis.Delete(context)

OCI Runtime Specification

containerd fully supports the OCI runtime specification for running containers. We have built in functions to help you generate runtime specifications based on images as well as custom parameters.

You can specify options when creating a container about how to modify the specification.

redis, err := client.NewContainer(context, "redis-master", containerd.WithNewSpec(oci.WithImageConfig(image)))

Root Filesystems

containerd allows you to use overlay or snapshot filesystems with your containers. It comes with builtin support for overlayfs and btrfs.

// pull an image and unpack it into the configured snapshotter
image, err := client.Pull(context, "docker.io/library/redis:latest", containerd.WithPullUnpack)

// allocate a new RW root filesystem for a container based on the image
redis, err := client.NewContainer(context, "redis-master",
	containerd.WithNewSnapshot("redis-rootfs", image),
	containerd.WithNewSpec(oci.WithImageConfig(image)),
)

// use a readonly filesystem with multiple containers
for i := 0; i < 10; i++ {
	id := fmt.Sprintf("id-%s", i)
	container, err := client.NewContainer(ctx, id,
		containerd.WithNewSnapshotView(id, image),
		containerd.WithNewSpec(oci.WithImageConfig(image)),
	)
}

Tasks

Taking a container object and turning it into a runnable process on a system is done by creating a new Task from the container. A task represents the runnable object within containerd.

// create a new task
task, err := redis.NewTask(context, cio.Stdio)
defer task.Delete(context)

// the task is now running and has a pid that can be use to setup networking
// or other runtime settings outside of containerd
pid := task.Pid()

// start the redis-server process inside the container
err := task.Start(context)

// wait for the task to exit and get the exit status
status, err := task.Wait(context)

Checkpoint and Restore

If you have criu installed on your machine you can checkpoint and restore containers and their tasks. This allow you to clone and/or live migrate containers to other machines.

// checkpoint the task then push it to a registry
checkpoint, err := task.Checkpoint(context)

err := client.Push(context, "myregistry/checkpoints/redis:master", checkpoint)

// on a new machine pull the checkpoint and restore the redis container
image, err := client.Pull(context, "myregistry/checkpoints/redis:master")

checkpoint := image.Target()

redis, err = client.NewContainer(context, "redis-master", containerd.WithCheckpoint(checkpoint, "redis-rootfs"))
defer container.Delete(context)

task, err = redis.NewTask(context, cio.Stdio, containerd.WithTaskCheckpoint(checkpoint))
defer task.Delete(context)

err := task.Start(context)

Snapshot Plugins

In addition to the built-in Snapshot plugins in containerd, additional external plugins can be configured using GRPC. An external plugin is made available using the configured name and appears as a plugin alongside the built-in ones.

To add an external snapshot plugin, add the plugin to containerd's config file (by default at /etc/containerd/config.toml). The string following proxy_plugin. will be used as the name of the snapshotter and the address should refer to a socket with a GRPC listener serving containerd's Snapshot GRPC API. Remember to restart containerd for any configuration changes to take effect.

[proxy_plugins]
  [proxy_plugins.customsnapshot]
    type = "snapshot"
    address =  "/var/run/mysnapshotter.sock"

See PLUGINS.md for how to create plugins

Releases and API Stability

Please see RELEASES.md for details on versioning and stability of containerd components.

Development reports.

Weekly summary on the progress and what is being worked on. https://github.com/containerd/containerd/tree/master/reports

Communication

For async communication and long running discussions please use issues and pull requests on the github repo. This will be the best place to discuss design and implementation.

For sync communication we have a community slack with a #containerd channel that everyone is welcome to join and chat about development.

Slack: https://dockr.ly/community

Reporting security issues

If you are reporting a security issue, please reach out discreetly at security@containerd.io.

Licenses

The containerd codebase is released under the Apache 2.0 license. The README.md file, and files in the "docs" folder are licensed under the Creative Commons Attribution 4.0 International License. You may obtain a copy of the license, titled CC-BY-4.0, at http://creativecommons.org/licenses/by/4.0/.