Go to file
Brian Goff 205625473f Close wait chan after sending status
This allows the caller to receive multiple times without blocking after
the first call.

This can be useful in cases like this:
```go
  ch, _  := task.Wait(ctx)
  defer func() { <-ch } // don't return until task is done
  task.Start(ctx)

  if err := doSomething(task); err != nil {
    return err
  }

  status := <- ch
  // do stuff with status
```

Since this channel is created in the `Wait()` calls and never accessible
outside, this should be safe.

Signed-off-by: Brian Goff <cpuguy83@gmail.com>
2017-10-16 16:55:43 -04:00
api Refactor differ into separate package 2017-10-11 10:02:29 -07:00
archive Remove umask, replace with explicit chmod after create 2017-10-11 15:13:18 -07:00
cmd Add snapshot label command to ctr 2017-10-16 11:54:01 -07:00
containers Update files based on go lint 2017-10-02 10:15:28 -04:00
content Add reference labels to snapshots and content 2017-10-11 10:42:47 -07:00
contrib fixes missing default permission 2017-09-20 13:15:39 -05:00
design Comment more packages to pass go lint 2017-10-02 13:54:56 -04:00
diff Abort newly created references on error 2017-10-11 10:10:19 -07:00
docs Update docs with go 1.9 requirement. 2017-10-12 15:06:36 +01:00
errdefs errdefs: use status package for mapping errors 2017-10-10 16:40:47 -07:00
events Update files based on go lint 2017-10-02 10:15:28 -04:00
filters Update files based on go lint 2017-10-02 10:15:28 -04:00
fs Remove umask, replace with explicit chmod after create 2017-10-11 15:13:18 -07:00
gc Metadata garbage collection 2017-10-11 10:42:47 -07:00
identifiers namespaces, identifiers: split validation 2017-07-12 14:46:47 -07:00
images Merge pull request #1567 from stevvooe/image-check-function 2017-10-04 11:40:43 -04:00
labels Comment more packages to pass go lint 2017-10-02 13:54:56 -04:00
linux linux: Pass correct path to runc when doing a checkpoint 2017-10-16 10:45:03 -07:00
log update to github.com/sirupsen/logrus v1.0.0 2017-07-21 15:39:14 -07:00
metadata Use single instance of snapshot and content stores 2017-10-16 11:57:50 -07:00
metrics/cgroups linux: Ensure count is 64bits aligned for proper atomic use on 32bits machines 2017-10-16 10:15:01 -07:00
mount Ensure getting the correct mountinfo corresponds to path 2017-10-08 17:16:28 +08:00
namespaces Comment more packages to pass go lint 2017-10-02 13:54:56 -04:00
platforms platforms: provide simpler function for common use 2017-09-20 11:56:59 -07:00
plugin Refactor differ into separate package 2017-10-11 10:02:29 -07:00
progress [progress] Fix wrong display of progress bar 2017-10-17 00:24:54 +08:00
protobuf api/services: define the introspection API 2017-10-10 16:40:47 -07:00
reaper Comment more packages to pass go lint 2017-10-02 13:54:56 -04:00
reference Comment more packages to pass go lint 2017-10-02 13:54:56 -04:00
releases release: prepare 1.0.0-beta.2 2017-10-11 18:09:32 -07:00
remotes Add reference labels to snapshots and content 2017-10-11 10:42:47 -07:00
reports Fix sublist in dev report 2017-06-26 10:58:05 -07:00
rootfs Add reference labels to snapshots and content 2017-10-11 10:42:47 -07:00
runtime ListPids returns process ID and other info 2017-10-10 22:57:15 +00:00
server services/introspection: implement plugin reporting 2017-10-10 17:29:24 -07:00
services Add checkpoint and userns gc labels 2017-10-11 11:26:46 -07:00
snapshot a typo in comment of Snapshotter.Update 2017-10-16 19:36:27 +08:00
sys Add solaris build support 2017-08-07 12:40:21 -07:00
testutil Move detach flags to platform specific 2017-08-22 17:20:25 -07:00
vendor Bump cgroups dep to 38a61430f7ceb01581fba6dd7ead48 2017-10-12 14:24:16 -04:00
version release: prepare 1.0.0-beta.2 2017-10-11 18:09:32 -07:00
windows Change hcsshimopts to hcsshimtypes package 2017-10-11 11:42:07 -07:00
.appveyor.yml Use golang 1.9 on AppVeyor CI 2017-08-25 08:58:40 -07:00
.gitignore Add initial containerd *Client 2017-05-24 14:08:58 -07:00
.travis.yml Bump runc with console change for ONLCR 2017-09-26 11:01:40 -04:00
benchmark_test.go Use namespace in default cgroup path 2017-10-09 17:07:57 -04:00
BUILDING.md Update docs with go 1.9 requirement. 2017-10-12 15:06:36 +01:00
client_opts.go client: Allow setting image labels on Pull() and Import() 2017-09-27 15:05:34 -07:00
client_test.go containerd: add state flag to specify state dir 2017-08-29 08:27:44 -07:00
client_unix_test.go Revert "Merge pull request #1502 from crosbymichael/test-image" 2017-09-21 15:25:34 -04:00
client_windows_test.go containerd: add state flag to specify state dir 2017-08-29 08:27:44 -07:00
client.go Refactor differ into separate package 2017-10-11 10:02:29 -07:00
code-of-conduct.md Add code of conduct 2017-04-04 09:41:38 -07:00
container_checkpoint_test.go Move spec generation to Container Create 2017-08-24 10:32:16 -04:00
container_linux_test.go Allow setting the uid & gid of the io pipes 2017-10-10 13:24:12 -07:00
container_opts_unix.go Add error wrapping for client checkpoint errors 2017-10-11 10:02:29 -07:00
container_opts.go Improve error message for WithContainerExtension 2017-10-13 13:41:52 -04:00
container_test.go Change hcsshimopts to hcsshimtypes package 2017-10-11 11:42:07 -07:00
container.go Add docs around multiple attach 2017-10-06 17:31:11 -04:00
containerd.service Add containerd unit file 2017-06-16 14:05:16 -07:00
containerstore.go Update client to pass go lint 2017-09-25 13:11:42 -04:00
content_test.go Add support for content labels on commit 2017-08-11 14:15:20 -07:00
CONTRIBUTING.md State adding tests when submitting changes 2017-09-25 11:33:24 -04:00
daemon_test.go Handle SIGKILL'ed shim while daemon is running 2017-08-29 08:27:44 -07:00
dialer_unix.go Merge pull request #1555 from crosbymichael/client-lint 2017-09-25 13:26:31 -04:00
dialer_windows.go Disable FailFast on client.IsServing() 2017-08-11 13:13:13 -07:00
dialer.go Merge pull request #1555 from crosbymichael/client-lint 2017-09-25 13:26:31 -04:00
export_test.go client: add Import() and Export() for importing/exporting image in OCI format 2017-07-28 04:47:53 +00:00
export.go Add platform filtering on children handler 2017-09-20 15:18:18 -07:00
grpc.go Add default namespace to client 2017-06-12 15:47:58 -07:00
helpers_unix_test.go Allow setting the uid & gid of the io pipes 2017-10-10 13:24:12 -07:00
helpers_windows_test.go Allow setting the uid & gid of the io pipes 2017-10-10 13:24:12 -07:00
image.go Add reference labels to snapshots and content 2017-10-11 10:42:47 -07:00
import_test.go client: add Import() and Export() for importing/exporting image in OCI format 2017-07-28 04:47:53 +00:00
import.go client: Allow setting image labels on Pull() and Import() 2017-09-27 15:05:34 -07:00
io_unix.go Update client to pass go lint 2017-09-25 13:11:42 -04:00
io_windows.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
io.go Add docs around multiple attach 2017-10-06 17:31:11 -04:00
LICENSE.code Update readme and version to 0.1.0 2016-03-21 13:01:28 -07:00
LICENSE.docs Update copyright and license 2015-12-18 00:08:16 +01:00
MAINTAINERS Update @mlaventure e-mail address 2017-10-13 14:50:33 -07:00
Makefile add release tool to generate releases 2017-10-11 18:51:13 -04:00
Makefile.darwin Only use race flag on amd64 2017-08-23 12:30:44 -04:00
Makefile.freebsd Only use race flag on amd64 2017-08-23 12:30:44 -04:00
Makefile.linux Only use race flag on amd64 2017-08-23 12:30:44 -04:00
Makefile.OS Breaking Makefile into platform specific files 2017-08-22 13:57:12 +09:00
Makefile.solaris Breaking Makefile into platform specific files 2017-08-22 13:57:12 +09:00
Makefile.windows Only use race flag on amd64 2017-08-23 12:30:44 -04:00
NOTICE Update readme and documentation for release 2015-12-16 12:15:22 -08:00
process.go Close wait chan after sending status 2017-10-16 16:55:43 -04:00
Protobuild.toml Change hcsshimopts to hcsshimtypes package 2017-10-11 11:42:07 -07:00
README.md Update docs with go 1.9 requirement. 2017-10-12 15:06:36 +01:00
RELEASES.md RELEASES: update component table 2017-09-21 13:18:55 -07:00
ROADMAP.md Replace roadmap with link to milestones 2017-07-24 13:42:35 -04:00
RUNC.md Bump runc with console change for ONLCR 2017-09-26 11:01:40 -04:00
SCOPE.md Update readme 2017-06-20 13:19:53 -07:00
snapshot_test.go Remove snapshot test suite as a parallel test runner 2017-08-22 16:29:17 -07:00
snapshotter_default_linux.go service/snapshotter: move default to client 2017-08-18 14:43:12 -07:00
snapshotter_default_unix.go service/snapshotter: move default to client 2017-08-18 14:43:12 -07:00
snapshotter_default_windows.go service/snapshotter: move default to client 2017-08-18 14:43:12 -07:00
spec_opts_unix.go Add checkpoint and userns gc labels 2017-10-11 11:26:46 -07:00
spec_opts_windows.go platforms: provide simpler function for common use 2017-09-20 11:56:59 -07:00
spec_opts.go Use namespace in default cgroup path 2017-10-09 17:07:57 -04:00
spec_unix_test.go Use namespace in default cgroup path 2017-10-09 17:07:57 -04:00
spec_unix.go Use namespace in default cgroup path 2017-10-09 17:07:57 -04:00
spec_windows.go Use namespace in default cgroup path 2017-10-09 17:07:57 -04:00
spec.go Use namespace in default cgroup path 2017-10-09 17:07:57 -04:00
task_opts.go Update client to pass go lint 2017-09-25 13:11:42 -04:00
task.go Close wait chan after sending status 2017-10-16 16:55:43 -04:00
vendor.conf Bump cgroups dep to 38a61430f7ceb01581fba6dd7ead48 2017-10-12 14:24:16 -04:00

banner

GoDoc Build Status FOSSA Status Go Report Card

containerd is an industry-standard container runtime with an emphasis on simplicity, robustness and portability. It is available as a daemon for Linux and Windows, which can manage the complete container lifecycle of its host system: image transfer and storage, container execution and supervision, low-level storage and network attachments, etc.

containerd is designed to be embedded into a larger system, rather than being used directly by developers or end-users.

architecture

Getting Started

If you are interested in trying out containerd please see our Getting Started Guide.

Features

Client

containerd offers a full client package to help you integrate containerd into your platform.


import "github.com/containerd/containerd"

func main() {
	client, err := containerd.New("/run/containerd/containerd.sock")
	defer client.Close()
}

Namespaces

Namespaces allow multiple consumers to use the same containerd without conflicting with each other. It has the benefit of sharing content but still having separation with containers and images.

To set a namespace for requests to the API:

context    = context.Background()
// create a context for docker
docker = namespaces.WithNamespace(context, "docker")

containerd, err := client.NewContainer(docker, "id")

To set a default namespace on the client:

client, err := containerd.New(address, containerd.WithDefaultNamespace("docker"))

Distribution

// pull an image
image, err := client.Pull(context, "docker.io/library/redis:latest")

// push an image
err := client.Push(context, "docker.io/library/redis:latest", image.Target())

Containers

In containerd, a container is a metadata object. Resources such as an OCI runtime specification, image, root filesystem, and other metadata can be attached to a container.

redis, err := client.NewContainer(context, "redis-master")
defer redis.Delete(context)

OCI Runtime Specification

containerd fully supports the OCI runtime specification for running containers. We have built in functions to help you generate runtime specifications based on images as well as custom parameters.

You can specify options when creating a container about how to modify the specification.

redis, err := client.NewContainer(context, "redis-master", containerd.WithNewSpec(containerd.WithImageConfig(image)))

Root Filesystems

containerd allows you to use overlay or snapshot filesystems with your containers. It comes with builtin support for overlayfs and btrfs.

// pull an image and unpack it into the configured snapshotter
image, err := client.Pull(context, "docker.io/library/redis:latest", containerd.WithPullUnpack)

// allocate a new RW root filesystem for a container based on the image
redis, err := client.NewContainer(context, "redis-master",
	containerd.WithNewSnapshot("redis-rootfs", image),
	containerd.WithNewSpec(containerd.WithImageConfig(image)),

)

// use a readonly filesystem with multiple containers
for i := 0; i < 10; i++ {
	id := fmt.Sprintf("id-%s", i)
	container, err := client.NewContainer(ctx, id,
		containerd.WithNewSnapshotView(id, image),
		containerd.WithNewSpec(containerd.WithImageConfig(image)),
	)
}

Tasks

Taking a container object and turning it into a runnable process on a system is done by creating a new Task from the container. A task represents the runnable object within containerd.

// create a new task
task, err := redis.NewTask(context, containerd.Stdio)
defer task.Delete(context)

// the task is now running and has a pid that can be use to setup networking
// or other runtime settings outside of containerd
pid := task.Pid()

// start the redis-server process inside the container
err := task.Start(context)

// wait for the task to exit and get the exit status
status, err := task.Wait(context)

Checkpoint and Restore

If you have criu installed on your machine you can checkpoint and restore containers and their tasks. This allow you to clone and/or live migrate containers to other machines.

// checkpoint the task then push it to a registry
checkpoint, err := task.Checkpoint(context, containerd.WithExit)

err := client.Push(context, "myregistry/checkpoints/redis:master", checkpoint)

// on a new machine pull the checkpoint and restore the redis container
image, err := client.Pull(context, "myregistry/checkpoints/redis:master")

checkpoint := image.Target()

redis, err = client.NewContainer(context, "redis-master", containerd.WithCheckpoint(checkpoint, "redis-rootfs"))
defer container.Delete(context)

task, err = redis.NewTask(context, containerd.Stdio, containerd.WithTaskCheckpoint(checkpoint))
defer task.Delete(context)

err := task.Start(context)

Developer Quick-Start

To build the daemon and ctr simple test client, the following build system dependencies are required:

  • Go 1.9.x or above
  • Protoc 3.x compiler and headers (download at the Google protobuf releases page)
  • Btrfs headers and libraries for your distribution. Note that building the btrfs driver can be disabled via build tag removing this dependency.

For proper results, install the protoc release into /usr/local on your build system. For example, the following commands will download and install the 3.1.0 release for a 64-bit Linux host:

$ wget -c https://github.com/google/protobuf/releases/download/v3.1.0/protoc-3.1.0-linux-x86_64.zip
$ sudo unzip protoc-3.1.0-linux-x86_64.zip -d /usr/local

With the required dependencies installed, the Makefile target named binaries will compile the ctr and containerd binaries and place them in the bin/ directory. Using sudo make install will place the binaries in /usr/local/bin. When making any changes to the gRPC API, make generate will use the installed protoc compiler to regenerate the API generated code packages.

Note

: A build tag is currently available to disable building the btrfs snapshot driver. Adding BUILDTAGS=no_btrfs to your environment before calling the binaries Makefile target will disable the btrfs driver within the containerd Go build.

Vendoring of external imports uses the vndr tool which uses a simple config file, vendor.conf, to provide the URL and version or hash details for each vendored import. After modifying vendor.conf run the vndr tool to update the vendor/ directory contents. Combining the vendor.conf update with the changeset in vendor/ after running vndr should become a single commit for a PR which relies on vendored updates.

Please refer to RUNC.md for the currently supported version of runc that is used by containerd.

Releases and API Stability

Please see RELEASES.md for details on versioning and stability of containerd components.

Development reports.

Weekly summary on the progress and what is being worked on. https://github.com/containerd/containerd/tree/master/reports

Communication

For async communication and long running discussions please use issues and pull requests on the github repo. This will be the best place to discuss design and implementation.

For sync communication we have a community slack with a #containerd channel that everyone is welcome to join and chat about development.

Slack: https://dockr.ly/community

Reporting security issues

If you are reporting a security issue, please reach out discreetly at containerd-security@googlegroups.com.

Copyright ©2016-2017 Docker, Inc. All rights reserved, except as follows. Code is released under the Apache 2.0 license. The README.md file, and files in the "docs" folder are licensed under the Creative Commons Attribution 4.0 International License under the terms and conditions set forth in the file "LICENSE.docs". You may obtain a duplicate copy of the same license, titled CC-BY-SA-4.0, at http://creativecommons.org/licenses/by/4.0/.