github/kubernetes
4
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
40,115 Commits 1 Branch 31 Tags 1,019 MiB
2708f5c7dd
Commit Graph

360 Commits

Author SHA1 Message Date
Hongchao Deng
51d9bb1f2b etcd3: have prefix to always prepended 2016-12-04 21:45:07 -08:00
Clayton Coleman
3454a8d52c
refactor: update bazel, codec, and gofmt 2016-12-03 19:10:53 -05:00
Clayton Coleman
5df8cc39c9
refactor: generated 2016-12-03 19:10:46 -05:00
Kubernetes Submit Queue
16a9c0b49c Merge pull request #37692 from wojtek-t/storage_resource_version_for_get 
Automatic merge from submit-queue

Handle RV in Get calls to storage interface.

Ref #37473
 2016-12-03 11:44:29 -08:00
Kubernetes Submit Queue
959d386ccf Merge pull request #36709 from hongchaodeng/e3 
Automatic merge from submit-queue (batch tested with PRs 35300, 36709, 37643, 37813, 37697)

[etcd] test cleanup: remove unnecessary AddPrefix()

What?
Remove etcdtest.AddPrefix() in tests. They will be automatically prepended in etcd storage.

Why?
ref: #36290 #36374
After the change, it will double prepend.
 2016-12-03 08:55:56 -08:00
Wojciech Tyczynski
ec247315be Handle RV in Get calls to storage interface. 2016-12-03 10:18:43 +01:00
Kubernetes Submit Queue
cd560926bd Merge pull request #36889 from wojtek-t/reuse_fields_and_labels 
Automatic merge from submit-queue

Reuse fields and labels

This should significantly reduce memory allocations in apiserver in large cluster.
Explanation:
- every kubelet is refreshing watch every 5-10 minutes (this generally is not causing relist - it just renews watch)
- that means, in 5000-node cluster, we are issuing ~10 watches per second
- since we don't have "watch heartbets", the watch is issued from previously received resourceVersion
- to make some assumption, let's assume pods are evenly spread across pods, and writes for them are evenly spread - that means, that a given kubelet is interested in 1 per 5000 pod changes
- with that assumption, each watch, has to process 2500 (on average) previous watch events
- for each of such even, we are currently computing fields.

This PR is fixing this problem.
 2016-12-02 21:49:43 -08:00
Wojciech Tyczynski
36e6cd19e1 Cache fields for filtering in watchCache. 2016-11-29 09:48:09 +01:00
Wojciech Tyczynski
ac7b1065e7 Better waiting for watch event delivery in cacher 2016-11-28 09:25:33 +01:00
Clayton Coleman
35a6bfbcee
generated: refactor 2016-11-23 22:30:47 -06:00
Chao Xu
bcc783c594 run hack/update-all.sh 2016-11-23 15:53:09 -08:00
Chao Xu
4f3d0e3bde more dependencies packages: 
pkg/metrics
pkg/credentialprovider
pkg/security
pkg/securitycontext
pkg/serviceaccount
pkg/storage
pkg/fieldpath
 2016-11-23 15:53:09 -08:00
Antoine Pelisse
e7bc178829 Revert "Add fast-path for Listing with ResourceVersion=0" 2016-11-18 14:15:08 -08:00
gmarek
e1542300ae Add fast-path for Listing with ResourceVersion=0 2016-11-18 13:54:10 +01:00
Kubernetes Submit Queue
38cc6df7b3 Merge pull request #36712 from hongchaodeng/e5 
Automatic merge from submit-queue

cacher test: fix leftover v2 test server

I think this was dismissed in #30890

@timothysc @wojtek-t
 2016-11-14 01:58:18 -08:00
Hongchao Deng
32a96b7dc0 pkg/storage: update bazel 2016-11-13 18:34:55 -08:00
Hongchao Deng
1972270f7b cacher test: fix leftover v2 test server 2016-11-13 16:22:24 -08:00
Hongchao Deng
3a28b7f848 test cleanup: remove unnecessary AddPrefix() 2016-11-12 16:04:23 -08:00
Hongchao Deng
5da4028aff etcd3: remove stale comments in test 2016-11-12 14:41:47 -08:00
Jordan Liggitt
7f61d37996
Fix watching from resourceVersion=0 in etcd3 watcher 2016-11-11 11:35:53 -08:00
Wojciech Tyczynski
f5cac3469e Add traces to etcd3 code 2016-11-09 16:13:46 +01:00
Wojciech Tyczynski
1f09d79584 Increase etcd3 compaction frequency 2016-10-31 08:40:13 +01:00
Andy Goldstein
d8fec75658 Fixes for golint tip 
golint as of
3390df4df2/lint.go (L1440-L1442)
requires that any function that has a context.Context argument have said
argument in the first position. This commit fixes the one function we had where
it wasn't.
 2016-10-27 12:07:23 -04:00
Kubernetes Submit Queue
6f80ec91d6 Merge pull request #35415 from wojtek-t/avoid_get 
Automatic merge from submit-queue

Try to avoid Get to etcd in GuaranteedUpdate in Cacher
 2016-10-26 16:15:06 -07:00
Kubernetes Submit Queue
6fd9acd3e1 Merge pull request #35621 from wojtek-t/reduce_watch_cache_lock_contention 
Automatic merge from submit-queue

Reduce lock contention in watchCache
 2016-10-26 14:23:30 -07:00
Wojciech Tyczynski
04e50ae119 Reduce lock contention in watchCache 2016-10-26 13:44:16 +02:00
Wojciech Tyczynski
5d2062db9f Reduce amount of not-helping logs in apiserver 2016-10-26 13:20:07 +02:00
Wojciech Tyczynski
a1090151ef Try to avoid Get to etcd in GuaranteedUpdate in Cacher 2016-10-25 21:59:02 +02:00
Mike Danese
3b6a067afc autogenerated 2016-10-21 17:32:32 -07:00
Wojciech Tyczynski
93c008f8a4 Support resourceVersion in GetToList - unify interface of List and GetToList 2016-10-21 10:09:23 +02:00
Kubernetes Submit Queue
5fcb9fd056 Merge pull request #35125 from wojtek-t/avoid_unnecessary_reallocations 
Automatic merge from submit-queue

Avoid unnecessary reallocations of slice in Cacher
 2016-10-19 20:33:13 -07:00
Wojciech Tyczynski
0ced3f43bf Avoid unnecessary reallocations of slice in Cacher 2016-10-19 19:33:33 +02:00
Wojciech Tyczynski
8040719d7f Avoid computing key func multiple times in cacher 2016-10-19 08:38:18 +02:00
Wojciech Tyczynski
f10b0205e7 Store keys in watchCache store 2016-10-19 08:38:18 +02:00
Wojciech Tyczynski
9895f337ee Avoid unnecessary copies in cacher 2016-10-19 08:33:58 +02:00
mbohlool
25afcc5522 Add +optional tag to all fields with omitempty json tag 2016-10-17 08:52:13 -07:00
Wojciech Tyczynski
0f2270698c Reduce amount of annoying logs in cacher 2016-10-17 16:15:24 +02:00
Wojciech Tyczynski
6d06a384ad Extend tracing in watchCache 2016-10-17 11:22:59 +02:00
Wojciech Tyczynski
4d5ac91f88 Add tracing to listing in Cacher 2016-10-17 08:58:40 +02:00
Wojciech Tyczynski
81779360de Accept Quorum parameter in etcd3. 2016-10-15 16:53:56 +02:00
Wojciech Tyczynski
2298e1746c Increase buffer sizes in cacher for watchers interested in all/many objects. 2016-10-13 16:40:33 +02:00
Wojciech Tyczynski
b675b2230c Avoid unnecessary decoding in etcd3 client 2016-10-11 10:38:46 +02:00
Hongchao Deng
2516ab058d etcd3 watcher: use prevKV for prevObj 2016-10-10 09:46:40 -07:00
Kubernetes Submit Queue
b5145e1924 Merge pull request #34322 from wojtek-t/cacher_improvements 
Automatic merge from submit-queue

Improve some logging in cacher
 2016-10-08 00:38:48 -07:00
deads2k
518d5500c7 remove testapi.Default.GroupVersion 2016-10-07 10:10:54 -04:00
Wojciech Tyczynski
c02df26ad6 Improve some logging in cacher 2016-10-07 15:04:08 +02:00
Wojciech Tyczynski
d70a9615ec Minor clearnup in etcd3 code 2016-10-06 15:38:34 +02:00
Wojciech Tyczynski
90bc19959d Extend logging in cacher to understand its bottleneck 2016-10-06 10:57:46 +02:00
Wojciech Tyczynski
82c360a252 Make gets for previous value in watch serializable 2016-10-05 13:18:31 +02:00
Hongchao Deng
35917e552a revert #32012 (Unshare cluster in each test suite) 
Since #33393 is merged, the bug should have been fixed.
 2016-09-27 09:38:18 -07:00