Commit Graph

3069 Commits

Author SHA1 Message Date
Michael Crosby
ca39f76f82
Merge pull request #1798 from stevvooe/shim-gomaxprocs
cmd/containerd-shim: set GOMAXPROCS to 2
2017-11-28 09:55:31 -05:00
Stephen J Day
d54961ccaa
vendor: add ttrpc as vendored dependency
Signed-off-by: Stephen J Day <stephen.day@docker.com>
2017-11-27 18:22:37 -08:00
Stephen Day
372cdfac3b
Merge pull request #1638 from dmcgowan/gc-policy
gc: add policy plugin
2017-11-27 18:20:10 -08:00
Derek McGowan
f011bec35e
Merge pull request #1800 from yanxuean/image-store-redandunt
remove redandunt check for imagestore create
2017-11-27 17:46:47 -08:00
Stephen J Day
0d957b1da5
oci: allocate process if not already set
Signed-off-by: Stephen J Day <stephen.day@docker.com>
2017-11-27 17:36:43 -08:00
yanxuean
3b670ebc94 remove redundant check for imagestore create
correct check object for imagestore update
Signed-off-by: yanxuean <yan.xuean@zte.com.cn>
2017-11-28 09:24:46 +08:00
Stephen J Day
5764bf1bad
cmd/containerd-shim: set GOMAXPROCS to 2
The shim doesn't need massive concurrency and a bunch of CPUs to do its
job correctly. We can reduce the number of threads to save memory at
little cost to performance.

Signed-off-by: Stephen J Day <stephen.day@docker.com>
2017-11-27 13:40:35 -08:00
Michael Crosby
abeb262d0d
Merge pull request #1796 from dnephin/move-oci-pkg
Move spec*.go files into a new oci package
2017-11-27 16:26:06 -05:00
Daniel Nephin
f6e877e8be Proposed fix for image content store
Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-27 16:16:17 -05:00
Daniel Nephin
a21a19a658 fix windows oci package
Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-27 16:16:17 -05:00
Daniel Nephin
cdf62f69a1 Fix usage of oci in other packages.
Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-27 16:16:17 -05:00
Daniel Nephin
081f8c7ce0 oci package passing tests
Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-27 16:14:43 -05:00
Michael Crosby
70e0c8443f
Merge pull request #1809 from Random-Liu/fix-build
fix build for WithLease
2017-11-27 13:38:09 -05:00
Lantao Liu
33c95bb418 Fix build.
Signed-off-by: Lantao Liu <lantaol@google.com>
2017-11-27 18:27:20 +00:00
Derek McGowan
a7ade66815
Merge pull request #1799 from yanxuean/provide-withLease
provide client.WithLease to user
2017-11-27 10:15:52 -08:00
Michael Crosby
9bf0a15946
Merge pull request #1808 from crosbymichael/stress-race
Fix race in stress test tool
2017-11-27 11:08:52 -05:00
Phil Estes
ff6c12b284
Merge pull request #1803 from dnephin/warn-on-mem-not-supported
Warn if OOM monitoring is not available instead of error
2017-11-27 11:07:11 -05:00
Michael Crosby
1cb0e81b5a Fix race in stress test tool
Signed-off-by: Michael Crosby <crosbymichael@gmail.com>
2017-11-27 10:55:13 -05:00
Phil Estes
12e7c76771
Merge pull request #1802 from yanxuean/unpack-lease
save snapshot from gc when unpack image
2017-11-27 09:37:21 -05:00
Michael Crosby
153fcfaea0
Merge pull request #1806 from dnephin/fix-ctr-events
Fix ctr events
2017-11-27 09:35:12 -05:00
Daniel Nephin
0103d14b47 Fix ctr events
add import to register event types with grpc

Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-24 14:28:44 -05:00
Daniel Nephin
8fe12adc20 Warn if OOM monitoring is not available
Instead of failing with an error

Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-23 15:10:44 -05:00
yanxuean
545f247c8e prevent snapshot from gc when unpack image
Signed-off-by: yanxuean <yan.xuean@zte.com.cn>
2017-11-23 17:29:29 +08:00
Phil Estes
4af5f65752
Merge pull request #1793 from dmcgowan/gc-add-container-test
metadata: add test for container as gc root
2017-11-22 21:36:05 -05:00
Phil Estes
908df29ad5
Merge pull request #1792 from dmcgowan/schema1-resumeable
Support unknown size from schema 1 manifests
2017-11-22 21:35:22 -05:00
yanxuean
d56b49dd7c provide client.WithLease to user
Signed-off-by: yanxuean <yan.xuean@zte.com.cn>
2017-11-23 10:24:41 +08:00
Stephen J Day
e8f52c35ce
linux/shim: reduce memory overhead by using ttrpc
By replacing grpc with ttrpc, we can reduce total memory runtime
requirements and binary size. With minimal code changes, the shim can
now be controlled by the much lightweight protocol, reducing the total
memory required per container.

When reviewing this change, take particular notice of the generated shim
code.

Signed-off-by: Stephen J Day <stephen.day@docker.com>
2017-11-22 12:21:48 -08:00
Stephen Day
8e09b565a7
Merge pull request #1795 from crosbymichael/cgroup-lock
Add lock around task cgroup
2017-11-22 12:09:02 -08:00
Michael Crosby
e830112efd Add lock around task cgroup
Signed-off-by: Michael Crosby <crosbymichael@gmail.com>
2017-11-22 11:14:08 -05:00
Michael Crosby
1a6e6a96a4
Merge pull request #1794 from yanxuean/some-typo
some typo
2017-11-22 10:51:48 -05:00
yanxuean
81307793b7 some typo
Signed-off-by: yanxuean <yan.xuean@zte.com.cn>
2017-11-22 11:48:09 +08:00
Derek McGowan
92d40b9a2d
Add test for container as gc root
Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-21 16:26:36 -08:00
Derek McGowan
bae47820d7
Document defaults
Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-21 16:12:10 -08:00
Derek McGowan
b674c64827
Support unknown size from schema 1 manifests
Schema1 manifests did not set a size in the digest for the blobs,
breaking the expectations of the update http seeking reader. Now
the http seeker has been updated to support unknown size as a
value of negative 1 and the schema1 puller sets the unknown size
accordingly.

Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-21 15:45:09 -08:00
Stephen Day
2b1c915f82
Merge pull request #1787 from AkihiroSuda/diff-link
fs/diff: support symlink to abspath with second-precision mtime
2017-11-21 10:33:25 -08:00
Michael Crosby
633f4a6b3e
Merge pull request #1751 from dnephin/add-unused-linters
Remove deadcode
2017-11-21 11:56:53 -05:00
Daniel Nephin
f74862a0dd Add structcheck, unused, and varcheck linters.
Warn on unused and dead code

Signed-off-by: Daniel Nephin <dnephin@gmail.com>
2017-11-21 11:14:37 -05:00
Michael Crosby
96e2f30250
Merge pull request #1759 from dnephin/single-integration-target
Remove duplicate integration target
2017-11-21 10:57:22 -05:00
Akihiro Suda
a3aeb398fe fs/diff: support symlink to abspath with second-precision mtime
Previously, `Changes()` for a symlink to absolute path, with second-precision
mtime of the link itself always resulted in ENOENT.

This is because `compareFileContent()` was called for the link target path, without changing the root path.

Fix moby/buildkit#172

Signed-off-by: Akihiro Suda <suda.akihiro@lab.ntt.co.jp>
2017-11-21 04:38:34 +00:00
Derek McGowan
374f04d0e9
Update gc policy configuration to use time duration
Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-20 17:08:35 -08:00
Derek McGowan
3f1a61f76a
Add synchronous image delete
Synchronous image delete provides an option image delete to wait
until the next garbage collection deletes after an image is removed
before returning success to the caller.

Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-20 17:08:35 -08:00
Derek McGowan
72fb8f8f40
Add gc labels to content tests
Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-20 16:57:40 -08:00
Derek McGowan
56b6a5dbd1
Add root labels to snapshot test suite
Prevents cleanup by garbage collectors running on snapshotters.

Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-20 16:57:40 -08:00
Derek McGowan
00596f400e
Add gc policy plugin
Add garbage collection as a background process and policy
configuration for configuring when to run garbage collection.
By default garbage collection will run when deletion occurs
and no more than 20ms out of every second.

Signed-off-by: Derek McGowan <derek@mcgstyle.net>
2017-11-20 16:57:39 -08:00
Michael Crosby
1bd39d36ed
Merge pull request #1788 from crosbymichael/plugin
Add plugin stability guarantees to release.md
2017-11-20 11:19:27 -05:00
Michael Crosby
23dfe54894 Add plugin stability guarantees to release.md
Closes #1336

Signed-off-by: Michael Crosby <crosbymichael@gmail.com>
2017-11-20 10:54:10 -05:00
Kenfe-Mickaël Laventure
9649a428e8
Merge pull request #1784 from stevvooe/remove-sync-write
content/local: don't open file with sync
2017-11-17 17:55:20 -08:00
Stephen Day
95cbe81247
Merge pull request #1783 from crosbymichael/static-shim
Compile shim without cgo for size and mem usage
2017-11-17 16:30:24 -08:00
Stephen J Day
5113299cb6
content/local: don't open file with sync
After running into performance issues when sending in certain kinds of
content, synchronous writes for content have been removed. Content is
still synced on commit, so this shouldn't be necessary.

Signed-off-by: Stephen J Day <stephen.day@docker.com>
2017-11-17 16:25:03 -08:00
Michael Crosby
67232e93dc
Merge pull request #1779 from AkihiroSuda/resolve-util-bin
shim: support non-default binary name
2017-11-17 17:53:43 -05:00