Commit Graph

8217 Commits

Author SHA1 Message Date
Yang Guo
324b091002 Update cos-dev image in benchmark tests to cos-dev-61-9759-0-0 2017-07-21 10:30:48 -07:00
Kubernetes Submit Queue
86b2fd380d Merge pull request #49347 from kubernetes/hollow-proxy-mem
Automatic merge from submit-queue

Reduce hollow proxy mem/node

As likely expected, kubemark-scale failed to even start with n1-standard-8 nodes. Because 1/3rd of our hollow nodes didn't even get scheduled due to their requests:

```
I0720 17:45:08.139] Found only 3325 ready hollow-nodes while waiting for 5000.
I0720 17:45:20.435] 3326 hollow-nodes are reported as 'Running'
I0720 17:45:20.442] 1675 hollow-nodes are reported as NOT 'Running'
```

If we want to experiment with smaller nodes anyway, then this change is needed. Though we most likely will end up OOM'ing.

Explanation for new value:
We have 62.5 hollow-node / real-node
=> mem available per hollow node = 30GB / 62.5 = 480MB
minus 100MB (kubelet)
minus 20MB (npd) 
=> 360MB for proxy should be = 100MB + 5000*(mem/node)
=> 50KB mem/node (with some slight slack)

cc @kubernetes/sig-scalability-misc
2017-07-21 09:59:31 -07:00
Kubernetes Submit Queue
e0c537a453 Merge pull request #48847 from bsalamat/e2e_test_conversion
Automatic merge from submit-queue

Add an integration test library and some integration tests for scheduler

**What this PR does / why we need it**:

1. Add an integration test library (utils.go) for scheduler testing.
2. Cleaned up some of the tests in scheduler_test.go with the new integration test library.
3. Add priority_test.go with a couple of examples on how to test scheduler priority function in integration tests.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```

ref/ #48176

@kubernetes/sig-scheduling-pr-reviews 
@davidopp @k82cn @vikaschoudhary16
2017-07-21 08:44:43 -07:00
Kubernetes Submit Queue
3d94338e44 Merge pull request #49163 from msau42/e2e-cleanup
Automatic merge from submit-queue (batch tested with PRs 49328, 49285, 49307, 49127, 49163)

Cleanup storage e2e test names

**What this PR does / why we need it**:
Some test names had redundant [sig-storage] tags.  Also, some tests still had [Volume] tag.  This PR removes those tags.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Release note**:

```release-note
NONE
```
/release-note-none
/sig storage
2017-07-21 03:00:23 -07:00
duan-yue
02b8d5073c remove unused function 2017-07-21 13:33:42 +08:00
Kubernetes Submit Queue
04df1f562b Merge pull request #49334 from saad-ali/fixPDgcloudListInstances
Automatic merge from submit-queue (batch tested with PRs 49330, 49252, 49262, 49278, 49334)

Add project to pd delete node gcloud command

**What this PR does / why we need it**: Add `--project=` to `gcloud compute instances list` calls from `Pod Disks should be able to detach from a node which was deleted`.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: Fixes #https://github.com/kubernetes/kubernetes/issues/49185

**Special notes for your reviewer**:

CC @kubernetes/sig-storage-pr-reviews
2017-07-20 21:59:36 -07:00
Kubernetes Submit Queue
3ff99d36ee Merge pull request #49262 from caesarxuchao/reenable-test
Automatic merge from submit-queue (batch tested with PRs 49330, 49252, 49262, 49278, 49334)

Enable garbage collector e2e tests

These tests are not running in pre-submit: see 753266cb7d/jobs/config.json (L9207)
2017-07-20 21:59:31 -07:00
Kubernetes Submit Queue
947700d146 Merge pull request #49207 from dixudx/remove_redundant_param_e2e_remote
Automatic merge from submit-queue

remove redundant param in e2e_node/remote

**What this PR does / why we need it**:

* remove redundant param in e2e_node/remote/remote.go
* fix a small typo

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
None
```
2017-07-20 20:16:38 -07:00
Shyam JVS
f81d9ed9b9 Reduce hollow proxy mem/node 2017-07-21 03:57:03 +02:00
Kubernetes Submit Queue
29f8ff32c2 Merge pull request #48073 from wanghaoran1988/e2e_bootstrap
Automatic merge from submit-queue (batch tested with PRs 49316, 46117, 49064, 48073, 49323)

add e2e tests for the bootstrapsigner and tokencleaner controllers, integration testing for bootstrap token auth

**What this PR does / why we need it**:
Add e2e test for bootstrap signer

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:
```
None
```
2017-07-20 17:02:52 -07:00
Kubernetes Submit Queue
6c5b24b564 Merge pull request #49064 from yguo0905/ubuntu-gke
Automatic merge from submit-queue (batch tested with PRs 49316, 46117, 49064, 48073, 49323)

Test Ubuntu image using GKE image spec on master

Ref: https://github.com/kubernetes/kubernetes/issues/46891

This PR changes the files referenced in test-infra for running Ubuntu image tests against GKE system spec on master.

The two properties files are shared by the tests against all k8s branches but the `SYSTEM_SPEC_NAME` is only available on master. This should be fine because the tests in the non master branches will just ignore the unknown env variable.

**Release note**:
```
None
```

/assign @yujuhong
2017-07-20 17:02:50 -07:00
Kubernetes Submit Queue
fb5fbc944a Merge pull request #46117 from ravisantoshgudimetla/scheduler_perf_arch
Automatic merge from submit-queue (batch tested with PRs 49316, 46117, 49064, 48073, 49323)

Modular extensions for kube scheduler perf testing framework

**What this PR does / why we need it**:

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #45973

**Special notes for your reviewer**:
It is not same as the existing one, the previous one has a single nodeaffinity key with multiple values. This one has multiple keys, values.

**Release note**:



```
NONE
```
2017-07-20 17:02:47 -07:00
saadali
c861d088ac Add project to pd delete node gcloud command 2017-07-20 15:54:37 -07:00
Kubernetes Submit Queue
5644e3d770 Merge pull request #49227 from deads2k/quota-01-tighten
Automatic merge from submit-queue (batch tested with PRs 49107, 47177, 49234, 49224, 49227)

tighten quota controller interface

While debugging a quota performance problem, I had to chase some references deeper than necessary because the interfaces were overly broad. This tightens them.

```release-note
NONE
```
2017-07-20 15:08:27 -07:00
Bobby (Babak) Salamat
2612422a7f Addressed reviewer comments 2017-07-20 14:59:18 -07:00
Bobby (Babak) Salamat
c6bf7b8f52 update bazel 2017-07-20 14:40:32 -07:00
Bobby (Babak) Salamat
96010e7e7a Deleted the converted e2e tests 2017-07-20 14:40:32 -07:00
Bobby (Babak) Salamat
238cb5bfc1 Converted a couple of e2e priority tests to integration tests. 2017-07-20 14:40:32 -07:00
Bobby (Babak) Salamat
684ac3f665 Added utility functions for scheduler integration testing and cleaned up
scheduler_test.go
2017-07-20 14:40:31 -07:00
Janet Kuo
ae20c7e743 Use AppsV1beta1 instead of Apps clienset
Apps clientset refers to AppsV1beta2 after apps/v1beta2 is created. Use
AppsV1beta1 for now before switching everything to AppsV1beta2.
2017-07-20 14:16:42 -07:00
David Ashpole
7a23f8b018 remove deprecated flags LowDiskSpaceThresholdMB and OutOfDiskTransitionFrequency 2017-07-20 13:23:13 -07:00
Michelle Au
e53ba82702 Cleanup storage e2e test names by removing redundant [sig-storage] tags and [Volume] tags 2017-07-20 11:11:40 -07:00
ymqytw
9b393a83d4 update godep 2017-07-20 11:03:49 -07:00
ymqytw
3dfc8bf7f3 update import 2017-07-20 11:03:49 -07:00
Janet Kuo
767082e8e9 Add new API version apps/v1beta2
Add a new API version apps/v1beta2 and enable it by default.
apps/v1beta2 has a copy of apps/v1beta1 types, except for
ControllerRevision.
2017-07-20 10:25:21 -07:00
Daniel Fernandes Martins
81ba522bbe Make NodeRestriction admission allow evictions for bounded pods 2017-07-20 14:20:03 -03:00
Yu-Ju Hong
d51c698181 Add yujuhong to test/e2e_node/OWNERS 2017-07-20 09:48:54 -07:00
Haoran Wang
f02008338f add integration testing for bootstrap token auth 2017-07-20 22:34:21 +08:00
Haoran Wang
0f2b79978a add e2e for bootstrap token cleaner 2017-07-20 21:45:04 +08:00
Haoran Wang
5f43150deb add e2e tests for bootstrap signer 2017-07-20 21:45:04 +08:00
Kubernetes Submit Queue
9f73d2420c Merge pull request #49209 from crassirostris/sd-logging-e2e-soak-test-logging-fix
Automatic merge from submit-queue

Fix too extensive logging in Stackdriver Logging e2e tests

Since logging pod now includes a cache, printing it out makes build-log unusable.
2017-07-20 05:26:42 -07:00
Michail Kargakis
e884eac6fe
Remove myself from a bunch of places
Signed-off-by: Michail Kargakis <mkargaki@redhat.com>
2017-07-20 12:10:46 +02:00
Zihong Zheng
5a2f226147 [e2e] Also verify content returned by kube-proxy healthz server 2017-07-19 23:22:15 -07:00
Manjunath A Kumatagi
cba065567f Move e2e dependent images from kubernetes/kubernetes.github.io repo 2017-07-20 09:48:18 +05:30
Chao Xu
ecd071539d reenable garbage collector e2e tests 2017-07-19 21:15:35 -07:00
Kubernetes Submit Queue
3e0dde91b6 Merge pull request #49062 from yguo0905/docker-validation-2
Automatic merge from submit-queue (batch tested with PRs 48377, 48940, 49144, 49062, 49148)

Add cos-dev-61-9733-0-0 to the benchmark tests

Ref: https://github.com/kubernetes/kubernetes/issues/42926

m60 has docker 1.13.1 while m61 has 17.03. This PR adds m61 to the benchmark tests so that we will have more data to compare.

PS: We will support fetching the latest image in an image family in the node e2e tests in the future.

**Release note**:

```
None
```

/assign @yujuhong 
/cc @kewu1992 @abgworrall
2017-07-19 19:10:16 -07:00
Kubernetes Submit Queue
f14472ffdd Merge pull request #49144 from mikedanese/sig-lifecycle-tests
Automatic merge from submit-queue (batch tested with PRs 48377, 48940, 49144, 49062, 49148)

fixit: break sig-cluster-lifecycle tests into subpackage

this is part of fixit week. ref #49161

@kubernetes/sig-cluster-lifecycle-misc
2017-07-19 19:10:14 -07:00
Kubernetes Submit Queue
8d26afa8a6 Merge pull request #48377 from bsalamat/priority_class
Automatic merge from submit-queue

Add PriorityClass API object under new "scheduling" API group

**What this PR does / why we need it**: This PR is a part of a series of PRs to add pod priority to Kubernetes. This PR adds a new API group called "scheduling" with a new API object called "PriorityClass". PriorityClass maps the string value of priority to its integer value.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**: Given the size of this PR, I will add the admission controller for the PriorityClass in a separate PR.

**Release note**:

```release-note
Add PriorityClass API object under new "scheduling" API group
```

ref/ #47604
ref/ #48646
2017-07-19 19:04:29 -07:00
Quentin MACHU
d4db482a45 Remove hostname label condition in SchedulerPredicates 2017-07-19 18:01:47 -07:00
Kubernetes Submit Queue
c9f8c26209 Merge pull request #49125 from abgworrall/handle-gke-clusters
Automatic merge from submit-queue (batch tested with PRs 47509, 46821, 45319, 49121, 49125)

Tolerate a missing MasterName (for GKE)

When testing, GKE created clusters don't provide a `MasterName`, so don't throw a warning and give up when that happens.

```release-note
NONE
```
2017-07-19 16:16:32 -07:00
Kubernetes Submit Queue
76c474eb99 Merge pull request #46821 from jeffvance/e2e-io
Automatic merge from submit-queue (batch tested with PRs 47509, 46821, 45319, 49121, 49125)

volume i/o tests for storage plugins

**What this PR does / why we need it**:
Addresses issues [25268](https://github.com/kubernetes/kubernetes/issues/25268) and [28367](https://github.com/kubernetes/kubernetes/issues/28367), though it may be weak re. the streaming i/o issue. @matchstick 

**Special notes for your reviewer**:
This is a new file. Plugins other than NFS, GlusterFS, iSCSI, and Ceph-RBD code will need to be supported in a separate PR.

```release-note
NONE
```
2017-07-19 16:16:26 -07:00
Kubernetes Submit Queue
042913d898 Merge pull request #47509 from billy2180/bump-mounttest-image-version-to-0.8
Automatic merge from submit-queue

Bump e2e mounttest image version to 0.8

Reduce the number of image files required for e2e test run
```release-note
NONE
```
2017-07-19 15:53:31 -07:00
ravisantoshgudimetla
b01a1c3881 Build files generated 2017-07-19 18:36:12 -04:00
ravisantoshgudimetla
9dbf1a5644 Refactoring taints to reduce sprawl 2017-07-19 18:36:07 -04:00
Kubernetes Submit Queue
04c4c21226 Merge pull request #49226 from zmerlynn/zml-test-owner
Automatic merge from submit-queue

test/OWNERS: add zmerlynn

```release-note
NONE
```
2017-07-19 14:49:31 -07:00
deads2k
62157572cf tighten quota controller interface 2017-07-19 15:36:45 -04:00
Zach Loafman
482e81cbd0 test/OWNERS: add zmerlynn 2017-07-19 12:28:37 -07:00
Kubernetes Submit Queue
c96f77a9b1 Merge pull request #49211 from saad-ali/moreLoggingFor49185
Automatic merge from submit-queue (batch tested with PRs 49143, 49211)

Add more logging to PD node delete test

**What this PR does / why we need it**: Adds more logging to `Pod Disks should be able to detach from a node which was deleted` test which started failing because `gcloud compute instances list` is failing with `exit status 1`.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: https://github.com/kubernetes/kubernetes/issues/49185

**Special notes for your reviewer**:

**Release note**: none
2017-07-19 12:12:24 -07:00
Kubernetes Submit Queue
b78fc209a4 Merge pull request #49045 from ericchiang/remove-anytoken-authenticator-option
Automatic merge from submit-queue (batch tested with PRs 49058, 49072, 49137, 49182, 49045)

*: remove --insecure-allow-any-token option

~Since the authenticator is still used in e2e tests, don't remove
the actual package. Maybe a follow up?~

edit: e2e and integration tests have been switched over to the tokenfile
authenticator instead.

```release-note
The --insecure-allow-any-token flag has been removed from kube-apiserver. Users of the flag should use impersonation headers instead for debugging.
```

closes #49031

cc @kubernetes/sig-auth-pr-reviews
2017-07-19 10:27:29 -07:00
Mike Danese
3c39173ee4 fixit: break sig-cluster-lifecycle tests into subpackage 2017-07-19 10:14:51 -07:00
Kubernetes Submit Queue
6af05149aa Merge pull request #49058 from shyamjvs/logexporter-support
Automatic merge from submit-queue

Pass logexporter config through e2e framework

Ref https://github.com/kubernetes/kubernetes/issues/48513

/cc @wojtek-t @fejta
2017-07-19 09:57:47 -07:00
Irfan Ur Rehman
7779377305 [Federation] Update to enable all apis in integration tests 2017-07-19 21:26:25 +05:30
saadali
4804e320e4 Add more logging to PD node delete test 2017-07-19 08:32:46 -07:00
Mik Vyatskov
ccdb97922d Fix too extensive logging in Stackdriver Logging e2e tests 2017-07-19 16:53:34 +02:00
Di Xu
769929ba49 remove redundant param in e2e_node/remote 2017-07-19 22:25:31 +08:00
Kubernetes Submit Queue
36ade22a5a Merge pull request #49116 from sttts/sttts-authorative-api-v1-ref
Automatic merge from submit-queue (batch tested with PRs 49116, 49095)

Move pkg/api/v1/ref -> client-go/tools/reference

`pkg/api/v1/ref` is the only remaining package copied from pkg/api/v1 to client-go via staging/copy.sh.
2017-07-19 03:21:25 -07:00
Kubernetes Submit Queue
2faf7ff2bc Merge pull request #36238 from resouer/eclass-2-dev
Automatic merge from submit-queue (batch tested with PRs 48043, 48200, 49139, 36238, 49130)

Implement equivalence cache by caching and re-using predicate result

The last part of #30844, I opened a new PR instead of overwrite the old one because we changed some basic assumption by allowing invalidating equivalence cache item by individual predicate.

The idea of this PR is based on discussion in https://github.com/kubernetes/kubernetes/issues/32024

- [x]  Pods belong to same controllerRef considered to be equivalent
- [x] ` podFitsOnNode` will use cached predicate result if it's available
- [x] Equivalence cache will be updated when if a fresh new predicate is done
- [x] `factory.go` will invalid specific predicate cache(s) based on the object change
- [x] Since `schedule` and `bind` are async, we need to optimistically invalid affected cache(s) before `bind`
- [x] Fully unit test of affected files
- [x] e2e test to verify cache update/invalid workflow
- [x] performance test results

- [x] Some nits fixes related but expected to result in `needs-rebase` so they are split to: #36060 #35968 #37512

cc @wojtek-t @davidopp
2017-07-19 01:57:32 -07:00
Kubernetes Submit Queue
2492477f0d Merge pull request #49110 from xiangpengzhao/remove-annotation-affinity
Automatic merge from submit-queue (batch tested with PRs 49055, 49128, 49132, 49134, 49110)

Remove affinity annotations leftover

**What this PR does / why we need it**:
This is a further cleanup for affinity annotations, following #47869.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #
ref: #47869

**Special notes for your reviewer**:
- I remove the commented test cases and just leave TODOs instead. I think converting these untestable test cases for now is not necessary. We can add new test cases in future.
- I remove the e2e test case `validates that embedding the JSON PodAffinity and PodAntiAffinity setting as a string in the annotation value work` because we have a test case `validates that InterPod Affinity and AntiAffinity is respected if matching` to test the same thing.

/cc @aveshagarwal @bsalamat  @gyliu513 @k82cn @timothysc 

**Release note**:

```release-note
NONE
```
2017-07-18 21:54:25 -07:00
ravisantoshgudimetla
f81f8b56ef Build files generated 2017-07-19 00:29:05 -04:00
ravisantoshgudimetla
739bf4d85f # This is a combination of 2 commits.
# The first commit's message is:

Modular extensions for kube scheduler perf testing framework

# This is the 2nd commit message:

Modular extensions for kube scheduler perf testing framework
2017-07-19 00:28:40 -04:00
Kubernetes Submit Queue
94c3c571fc Merge pull request #48535 from mkumatag/debian_base
Automatic merge from submit-queue (batch tested with PRs 48914, 48535, 49099, 48935, 48871)

Adopt debian-base as baseimage

**What this PR does / why we need it**:
Based on discussion from - https://github.com/kubernetes/kubernetes/pull/44910/files#r125150263
**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #49169

**Special notes for your reviewer**:

**Release note**:

```NONE
```
2017-07-18 21:04:22 -07:00
Kubernetes Submit Queue
fe7c29260f Merge pull request #48965 from mindprince/fixit-week
Automatic merge from submit-queue (batch tested with PRs 48702, 48965, 48740, 48974, 48232)

Move GPU e2e tests under owning SIG.

Supercedes #48723

**Release note**:
```release-note
NONE
```
/sig scheduling
/assign @vishh @fejta @grodrigues3
2017-07-18 20:06:16 -07:00
Kubernetes Submit Queue
fc1d2b3be7 Merge pull request #48256 from xiangpengzhao/move-pkg-util
Automatic merge from submit-queue (batch tested with PRs 48481, 48256)

Refactor: pkg/util into sub-pkgs

**What this PR does / why we need it**:
- move code in pkg/util into sub-pkgs
- delete some unused funcs

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #15634

**Special notes for your reviewer**:
This is the final work of #15634. It will close that issue.
/cc @thockin 

**Release note**:

```release-note
NONE
```
2017-07-18 18:19:19 -07:00
jeff vance
a113d8ac41 volume i/o tests for storage plugins 2017-07-18 17:59:15 -07:00
Bobby Salamat
33e6a476ba Add PriorityClass API
Add PriorityClass to pkg/registry

Add PriorityClass to pkg/master/master.go

Add PriorityClass to import_know_versions.go

Update linted packages

minor fix
2017-07-18 17:47:57 -07:00
Eric Chiang
e2f2ab67f2 *: remove --insecure-allow-any-token option
e2e and integration tests have been switched over to the tokenfile
authenticator instead.

```release-note
The --insecure-allow-any-token flag has been removed from kube-apiserver. Users of the flag should use impersonation headers instead for debugging.
```
2017-07-18 16:03:15 -07:00
Shyam Jeedigunta
5cdedd22cf Pass logexporter config through e2e framework 2017-07-18 23:28:06 +02:00
Dr. Stefan Schimanski
5925a0a1df Move pkg/api/v1/ref -> client-go/tools/reference 2017-07-18 22:45:43 +02:00
Fabiano Franz
71cbad7cbb Flag support in kubectl plugins 2017-07-18 15:35:40 -03:00
Kubernetes Submit Queue
ac742fa9f2 Merge pull request #46094 from atlassian/sync-informer-run
Automatic merge from submit-queue (batch tested with PRs 46094, 48544, 48807, 49102, 44174)

Shared Informer Run blocks until all goroutines finish

**What this PR does / why we need it**:
Makes Shared Informer Run method block until all goroutines it spawned finish. See #45454.

**Which issue this PR fixes**
Fixes #45454

**Release note**:
```release-note
NONE
```
2017-07-18 11:20:48 -07:00
Rohit Agarwal
cad0fe599c Move GPU e2e tests under owning SIG. 2017-07-18 10:31:48 -07:00
Adam Worrall
14091e4043 Tolerate a missing MasterName (for GKE)
GKE created clusters don't provide a MasterName, so don't
throw a warning and give up when that happens.
2017-07-18 09:55:15 -07:00
Harry Zhang
f817b8a6f6 Update generated bazel 2017-07-18 23:58:32 +08:00
Harry Zhang
0e8517875e Update factory.go informers to update equivalence cache
Fix tombstone

Add e2e to verify equivalence cache

Addressing nits in factory,go and e2e

Update build files
2017-07-18 23:55:01 +08:00
xiangpengzhao
d9d3396566 Remove affinity annotations leftover 2017-07-18 19:42:52 +08:00
Kubernetes Submit Queue
8dcedb0ecb Merge pull request #48879 from aleksandra-malinowska/test-cleanup
Automatic merge from submit-queue

Update autoscaling tests OWNERS

Add current members of autoscaling team to autoscaling tests OWNERS
2017-07-18 03:36:35 -07:00
Kubernetes Submit Queue
54b68a2a3f Merge pull request #49013 from crassirostris/sd-logging-e2e-soak-test-fix
Automatic merge from submit-queue (batch tested with PRs 48983, 49013)

Reduce SD Logging soak test duration & fix problem with multiple nodes

Fixes https://github.com/kubernetes/kubernetes/issues/49012

/cc @piosz
2017-07-18 02:23:45 -07:00
xiangpengzhao
01daf707c5 Refactor: pkg/util into sub-pkgs 2017-07-18 14:34:08 +08:00
Kubernetes Submit Queue
0fab9c2872 Merge pull request #48919 from YuxiJin-tobeyjin/e2enamespace
Automatic merge from submit-queue (batch tested with PRs 49019, 48919, 49040, 49018, 48874)

correcting spell mistake

**What this PR does / why we need it**:
Correcting spell mistake.
**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #
NONE
**Special notes for your reviewer**:
NONE
**Release note**:
NONE
```release-note
```
2017-07-17 21:25:07 -07:00
Mikhail Mazurskiy
d789615902
Shared Informer Run blocks until all goroutines finish
Fixes #45454
2017-07-18 14:05:08 +10:00
Kubernetes Submit Queue
e09a353942 Merge pull request #49037 from krousey/upgrades
Automatic merge from submit-queue

Sanitize test names before using them as namespaces

**What this PR does / why we need it**: It sanitizes upgrade test names before creating namespaces.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #48876
2017-07-17 20:30:20 -07:00
Kubernetes Submit Queue
1fe2bb30b7 Merge pull request #49020 from mkumatag/update_yamls
Automatic merge from submit-queue (batch tested with PRs 48231, 47377, 48797, 49020, 49033)

Update yaml and json with multi arch test images

**What this PR does / why we need it**:
This PR is for updating the yaml and json files under test/images folder with multi arch images
**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```NONE
```
2017-07-17 19:37:47 -07:00
YuxiJin-tobeyjin
be725e0728 correcting spell mistake 2017-07-18 09:57:30 +08:00
Yang Guo
c979d7f167 Test Ubuntu image using GKE image spec 2017-07-17 16:18:17 -07:00
Yang Guo
248930bc7d Add cos-beta-60-9592-52-0 to the benchmark tests 2017-07-17 15:53:15 -07:00
Jacob Simpson
b565f53822 update-bazel.sh 2017-07-17 15:06:08 -07:00
Jacob Simpson
8bcbbd4d08 Migrate api.Registry to testapi.Groups in tests. 2017-07-17 15:05:38 -07:00
Jacob Simpson
a765b8cfca Migrate api.Scheme to scheme.Scheme 2017-07-17 15:05:38 -07:00
Jacob Simpson
29c1b81d4c Scripted migration from clientset_generated to client-go. 2017-07-17 15:05:37 -07:00
Kris
33654b8b61 Sanitize test names before using them as namespaces 2017-07-17 10:45:05 -07:00
Kubernetes Submit Queue
8b39fa9cd1 Merge pull request #48494 from mkumatag/webserver
Automatic merge from submit-queue (batch tested with PRs 48494, 48733)

Move test-webserver from contrib/for-demos to kubernetes/test/images

**What this PR does / why we need it**:
This PR is for
- Moving the https://github.com/kubernetes/contrib/tree/master/for-demos/test-webserver to kubernetes/test/images - Refer https://github.com/kubernetes/contrib/pull/2544 for more information
- Multi architecture support for test-webserver image

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
```
2017-07-17 08:43:37 -07:00
Kubernetes Submit Queue
5c32b7d1eb Merge pull request #48908 from shyamjvs/reduce-services-loadtest
Automatic merge from submit-queue (batch tested with PRs 48991, 48908)

Group every two services into one in load test

Ref https://github.com/kubernetes/kubernetes/issues/48938

Following from discussion with @bowei and @freehan .
This reduces #services to 8200 while keeping no. of backends same.

/cc @wojtek-t @gmarek
2017-07-17 07:02:03 -07:00
Kubernetes Submit Queue
d54ab221cd Merge pull request #48991 from smarterclayton/cleanup_restclient
Automatic merge from submit-queue

Remove old, core/v1 specific constructs from RESTClient

Now that metav1 is abstracted from the APIs, RESTClient should also be agnostic to the core API.

* Remove `LabelSelectorParam` and `FieldSelectorParam` - use `VersionedParams` with `ListOptions`
* Remove `UintParam`
* Remove all legacy field selector logic from `VersionedParams` - ParameterCodec now handles that
* Remove special parameters (like `timeout`) which is no longer set by most clients
2017-07-17 06:50:18 -07:00
Manjunath A Kumatagi
9ebd6f06b6 Update yaml and json with multi arch test images 2017-07-17 17:53:36 +05:30
Shyam Jeedigunta
26006af4e0 Group every two services into one in load test 2017-07-17 14:19:30 +02:00
Mik Vyatskov
1710549f1f Reduce SD Logging soak test duration & fix problem with multiple nodes 2017-07-17 13:58:24 +02:00
Maciej Pytel
f53be7bd22 Fix condition in autoscaler e2e
Fix off-by-one in cluster-autoscaler that made the test trivially
pass (without actually requiring scale-up to happen).
2017-07-17 10:57:11 +02:00
Kubernetes Submit Queue
396d8b1189 Merge pull request #48280 from MaciekPytel/ca_scale_to_0_e2e_2
Automatic merge from submit-queue (batch tested with PRs 46091, 48280)

Added scale-down-to-0 e2e for cluster autoscaler
2017-07-16 18:04:45 -07:00
Kubernetes Submit Queue
0c74c36b70 Merge pull request #46930 from k82cn/sched_integ_test
Automatic merge from submit-queue (batch tested with PRs 47417, 47638, 46930)

Added scheduler integration test owners.

**What this PR does / why we need it**:
Add OWNER file into scheduler integration test.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes # N/A

**Release note**:
```release-note-none
```
2017-07-16 16:33:05 -07:00
Clayton Coleman
b6d9815b95
Remove use of (Label|Field)SelectorParam 2017-07-16 15:56:11 -04:00
Mik Vyatskov
9d3356c612 Sig-instrumentation e2e tests refactoring 2017-07-16 16:41:09 +02:00
David Oppenheimer
a836d55d0f Mark sig-scheduling tests with [sig-scheduling] so they can be selected
for the testdash dashboard.
2017-07-15 00:07:30 -07:00
Kubernetes Submit Queue
226b39c6b5 Merge pull request #48896 from yguo0905/docker-validation-m60
Automatic merge from submit-queue (batch tested with PRs 48890, 46893, 48872, 48896)

Add cos-beta-60-9592-52-0 to the benchmark tests

This PR depends on https://github.com/kubernetes/kubernetes/pull/48824.

This PR adds new resource usage tests for cos-beta-60-9592-52-0 (docker 1.13.1).

Ref: #42926

**Release note**:
```
None
```
/sig node
/area node-e2e
/assign @dchen1107
/cc @abgworrall
2017-07-14 16:49:55 -07:00
Kubernetes Submit Queue
cab07f3af0 Merge pull request #46893 from yguo0905/image-spec
Automatic merge from submit-queue (batch tested with PRs 48890, 46893, 48872, 48896)

Support customized system spec in the node conformance test and create the GKE system spec

ref: https://github.com/kubernetes/kubernetes/issues/46891

- System specs are located in `test/e2e_node/system/specs`. Created one for validating GKE images in `test/e2e_node/system/specs/gke.yaml`.
- `--image-spec-name` can be used to specify a system spec in node e2e and conformance tests. This option maps to `SYSTEM_SPEC_NAME` in a test properties file, which is the user facing configuration. So, users can specify `SYSTEM_SPEC_NAME=gke` to run the image validation using the GKE system spec.
- If `SYSTEM_SPEC_NAME` is unspecified, the default spec (`system.DefaultSysSpec`) will be used.
- We can also use `make test-e2e-node SYSTEM_SPEC_NAME=gke` to run tests using GKE image spec.

**Release note**:
`None`
2017-07-14 16:49:52 -07:00
Kubernetes Submit Queue
f9cb6f9bba Merge pull request #48890 from jpbetz/group-api-machinery-e2e-tests
Automatic merge from submit-queue

Move api-machinery related e2e tests to a 'api-machinery' e2e test su…

…bdirectory.



**What this PR does / why we need it**:

Moves all e2e tests belonging to sig-api-machinery into a dedicated `test/e2e/apimachinery ` directory and updates the tests to use `SigDescribe` to prepend `[sig-api-machinery]` to the testnames of all apimachinery owned tests.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2017-07-14 16:14:49 -07:00
Kubernetes Submit Queue
23e60ac9ad Merge pull request #48308 from yguo0905/docker-api
Automatic merge from submit-queue

Update Docker API in Kubelet

Ref: https://github.com/kubernetes/kubernetes/issues/34308

The Kubelet currently uses deprecated docker API (https://godoc.org/github.com/docker/engine-api). This PR changes it to use the new one (https://godoc.org/github.com/moby/moby/client).

This PR updated the docker package from 1.11 to 1.13.1-rc2.

**Release note**:
```
None
```

/assign @Random-Liu 
/cc @yujuhong
2017-07-14 15:30:59 -07:00
Joe Betz
b7c1bb43aa Move api-machinery related e2e tests to a 'api-machinery' e2e test subdirectory. 2017-07-14 14:04:50 -07:00
Kubernetes Submit Queue
fcfe9a2636 Merge pull request #48895 from crimsonfaith91/move-upgrade
Automatic merge from submit-queue (batch tested with PRs 48578, 48895, 48958)

move sig-apps upgrade tests to its directory

**What this PR does / why we need it**: This PR moves sig-apps upgrade tests to its directory in accord to fixit requirements.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #48839

**Special notes for your reviewer**:

**Release note**:

```release-note
```
2017-07-14 13:45:53 -07:00
Kubernetes Submit Queue
87445c5c99 Merge pull request #47090 from mikedanese/bazel-integration
Automatic merge from submit-queue (batch tested with PRs 48572, 48838, 48931, 48783, 47090)

Start etcd in integration tests with TestMain

https://github.com/kubernetes/kubernetes/issues/47089
2017-07-14 10:53:53 -07:00
Kubernetes Submit Queue
9e97b5249b Merge pull request #46360 from khenidak/azure-pd-final
Automatic merge from submit-queue

Azure PD (Managed/Blob)

This is exactly the same code as this [PR](https://github.com/kubernetes/kubernetes/pull/41950). It has a clean set of generated items. We created a separate PR to accelerate the accept/merge the PR

CC @colemickens 
CC @brendandburns 

**What this PR does / why we need it**:

1. Adds K8S support for Azure Managed Disks. 
2. Adds support for dedicated blob disks (1:1 to storage account) in addition to shared blob disks (n:1 to storage account). 
3. Automatically manages the underlying storage accounts. New storage accounts are created at 50% utilization. Max is 100 disks, 60 disks per storage account.    
2. Addresses the current issues with Blob Disks:
..* Significantly faster attach process. Disks are now usually available for pods on nodes under 30 sec if formatted, under a min if not formatted. 
..* Adds support to move disks between nodes.
..* Adds consistent attach/detach behavior, checks if the disk is leased/attached on a different node before attempting to attach to target nodes.
..* Fixes a random hang behavior on Azure VMs during mount/format (for both blob + managed disks).
..* Fixes a potential conflict by avoiding the use of disk names for mount paths. The new plugin uses hashed disk uri for mount path.  

The existing AzureDisk is used as is. Additional "kind" property was added  allowing the user to decide if the pd will be shared, dedicated or managed (Azure Managed Disks are used).

Due to the change in mounting paths, existing PDs need to be recreated as PV or PVCs on the new plugin.
2017-07-14 09:57:51 -07:00
Yang Guo
22c9e23202 Supports customized system spec in the node conformance test and creates the GKE system spec 2017-07-14 09:39:19 -07:00
gmarek
639718dfc5 Remove max-pods density test 2017-07-14 14:32:29 +02:00
Kubernetes Submit Queue
9099e8e95f Merge pull request #48870 from aleksandra-malinowska/autoscaling-tests-extra-logs
Automatic merge from submit-queue

add more logs for debugging to autoscaling tests

Add logging raw Cluster Autoscaler configmap if it can't be parsed.
2017-07-14 03:34:48 -07:00
Kubernetes Submit Queue
ca0a868823 Merge pull request #48651 from shyamjvs/logexporter-supporter
Automatic merge from submit-queue (batch tested with PRs 48864, 48651, 47703)

Enable logexporter mechanism to dump logs from k8s nodes to GCS directly

Ref https://github.com/kubernetes/kubernetes/issues/48513

This adds support for logexporter from k8s side. Next I'll send a PR adding support from test-infra side.

/cc @kubernetes/sig-scalability-misc @kubernetes/test-infra-maintainers @fejta @wojtek-t @gmarek
2017-07-14 03:10:45 -07:00
Manjunath A Kumatagi
6f464259b6 Adopt debian-base as baseimage 2017-07-14 15:08:54 +05:30
Kubernetes Submit Queue
096edd6452 Merge pull request #48826 from mikedanese/fix-upgrade
Automatic merge from submit-queue (batch tested with PRs 46748, 48826)

scheduler e2e: make container name shorter

Fixes https://github.com/kubernetes/kubernetes/issues/48825
2017-07-14 02:03:43 -07:00
Khaled Henidak & Andy Zhang
677e593d86 Add Azure managed disk support 2017-07-14 14:09:44 +08:00
Kubernetes Submit Queue
a14abaabab Merge pull request #48824 from yguo0905/docker-validation
Automatic merge from submit-queue (batch tested with PRs 48082, 48815, 48901, 48824)

Add test image name to the OS image field of the perf metrics

I'd like to add the resource usage benchmarks for COS m60 (docker 1.13.1) but don't want to remove the existing m59 (docker 1.11.2) [ones](https://github.com/kubernetes/kubernetes/blob/master/test/e2e_node/jenkins/benchmark/benchmark-config.yaml#L51-L71), in order to compare the results between the two docker versions.

The `image` reported in the metrics is from `Node.Status.NodeInfo.OSImage`, which is always "Container-Optimized OS from Google" (from `/etc/os-releases`) for COS. So there's no way to differentiate two milestones in the metrics.

This PR attaches the [image name](https://github.com/kubernetes/kubernetes/blob/master/test/e2e_node/jenkins/benchmark/benchmark-config.yaml#L52) to the `image` field of the metrics. So it will become "Container-Optimized OS from Google (cos-stable-59-9460-64-0)".

See the results of the test run:

[performance-memory-containervm-resource1-resource_0.json](https://storage.googleapis.com/ygg-gke-dev-bucket/e2e-node-test/ci-kubernetes-node-kubelet-benchmark/13/artifacts/performance-memory-containervm-resource1-resource_0.json)
[performance-memory-coreos-resource1-resource_0.json](https://storage.googleapis.com/ygg-gke-dev-bucket/e2e-node-test/ci-kubernetes-node-kubelet-benchmark/13/artifacts/performance-memory-coreos-resource1-resource_0.json)
[performance-memory-gci-resource1-resource_0.json](https://storage.googleapis.com/ygg-gke-dev-bucket/e2e-node-test/ci-kubernetes-node-kubelet-benchmark/13/artifacts/performance-memory-gci-resource1-resource_0.json)

**Release note**:
```
None
```

Ref: https://github.com/kubernetes/kubernetes/issues/42926

/sig node
/area node-e2e
/assign @dchen1107
2017-07-13 22:44:00 -07:00
Kubernetes Submit Queue
1f99cb2a9e Merge pull request #48901 from pwittrock/master
Automatic merge from submit-queue (batch tested with PRs 48082, 48815, 48901, 48824)

Import kubectl tests in e2e_test.go so they start running.

```release-note
NONE
```
2017-07-13 22:43:58 -07:00
YuxiJin-tobeyjin
18d932586b Correcting two spelling mistakes Reustable->Reusable adversly->adversely 2017-07-14 10:14:59 +08:00
Kubernetes Submit Queue
8ad1be7833 Merge pull request #44475 from freehan/checkpoint-test
Automatic merge from submit-queue

add dockershim checkpoint node e2e test

Add a bunch of disruptive cases to test kubelet/dockershim's checkpoint work flow.

Some steps are quite hacky. Not sure if there is better ways to do things.
2017-07-13 18:50:10 -07:00
Kubernetes Submit Queue
ea78fe40db Merge pull request #47890 from marun/fed-namespace-sync
Automatic merge from submit-queue (batch tested with PRs 47999, 47890)

[Federation] Update namespace support to use the sync controller

This PR moves namespaces to use the sync controller.

cc: @kubernetes/sig-federation-pr-reviews
2017-07-13 17:13:39 -07:00
Kubernetes Submit Queue
fa5b580c06 Merge pull request #47999 from ianchakeres/local-volume-2pod-e2e
Automatic merge from submit-queue (batch tested with PRs 47999, 47890)

LocalPV e2e test with two pods writing/reading to a shared file on one PVC

**What this PR does / why we need it**:

This PR adds an e2e test where one pod writes to a localPV and another reads from it. This e2e test is for the PersistentLocalVolumes alpha feature.

**Which issue this PR fixes**: fixes https://github.com/kubernetes/kubernetes/issues/48832

**Special notes for your reviewer**:

You need to setup the PersistentLocalVolumes feature-gate and NODE_LOCAL_SSDS environment variable.

For example:

```
KUBE_FEATURE_GATES="PersistentLocalVolumes=true" NODE_LOCAL_SSDS=1 go run hack/e2e.go -- -v --up

go run hack/e2e.go -- -v --test --test_args="--ginkgo.focus=\[Feature:LocalPersistentVolumes\]"

```
**Release note**:

```release-note
NONE
```
2017-07-13 17:13:36 -07:00
Phillip Wittrock
3c3c271d07 Import kubectl tests in e2e_test.go so they start running.
Also rename the Describe function
2017-07-13 15:10:17 -07:00
Jun Xiang Tee
3b75093e0a move sig-apps upgrade tests to its directory 2017-07-13 13:53:06 -07:00
Yang Guo
bf2ced837c Updates Docker Engine API 2017-07-13 12:55:07 -07:00
Yang Guo
22253a6e6a Add cos-beta-60-9592-52-0 to benchmark tests 2017-07-13 12:06:59 -07:00
Jing Xu
bb1920edcc Fix issues for local storage allocatable feature
This PR fixes the following issues:
1. Use ResourceStorageScratch instead of ResourceStorage API to represent
local storage capacity
2. In eviction manager, use container manager instead of node provider
(kubelet) to retrieve the node capacity and reserved resources. Node
provider (kubelet) has a feature gate so that storagescratch information
may not be exposed if feature gate is not set. On the other hand,
container manager has all the capacity and allocatable resource
information.
2017-07-13 12:06:19 -07:00
Maru Newby
6ba0e92bf4 fed: Enable the namespace controller in integration tests 2017-07-13 09:50:07 -07:00
gmarek
afe1a2c71b Revert "Merge pull request #48560 from nicksardo/gce-network-project"
This reverts commit d4881dd491, reversing
changes made to b5c4346130.
2017-07-13 18:34:24 +02:00
Aleksandra Malinowska
7eb429644e Add current members of autoscaling teams to autoscaling tests OWNERS 2017-07-13 17:23:38 +02:00
Ian Chakeres
791970025e Added localPV e2e tests with two pods and refactored existing tests 2017-07-13 08:53:57 -04:00
Aleksandra Malinowska
e12e630376 add more logs for debugging to autoscaling tests 2017-07-13 11:40:49 +02:00
Pengfei Ni
721047fe49 Add e2e test for readOnlyRootFilesystem containers 2017-07-13 17:21:29 +08:00
Kubernetes Submit Queue
74f1943774 Merge pull request #48849 from nicksardo/gce-panic-fix
Automatic merge from submit-queue (batch tested with PRs 48555, 48849)

GCE: Fix panic when service loadbalancer has static IP address

Fixes #48848 

```release-note
Fix service controller crash loop when Service with GCP LoadBalancer uses static IP (#48848, @nicksardo)
```
2017-07-12 23:59:03 -07:00
Kubernetes Submit Queue
222ac7be1e Merge pull request #48845 from crimsonfaith91/upgrade-test
Automatic merge from submit-queue

add [sig-apps] identifier to relevant upgrade tests

**What this PR does / why we need it**: This PR adds [sig-apps] identifier to relevant upgrade tests.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: xref #48839

**Special notes for your reviewer**:

**Release note**:

```release-note
```
2017-07-12 20:07:13 -07:00
Nick Sardo
98368d974e Remove address getter from CreateAddress(Region and Global) 2017-07-12 20:06:18 -07:00
Mike Danese
6ae11fdc5d use testmain in integration tests 2017-07-12 17:34:55 -07:00
Mike Danese
8e23c656ca add testmain setup func to the integration framework 2017-07-12 17:34:55 -07:00
Jun Xiang Tee
c35662b667 add [sig-apps] identifier to relevant upgrade tests 2017-07-12 16:48:44 -07:00
Jun Xiang Tee
0c93f75629 add [sig-apps] prefix to workload e2e tests 2017-07-12 16:37:27 -07:00
Kubernetes Submit Queue
4da48f1c04 Merge pull request #48827 from foxish/move-more-e2e
Automatic merge from submit-queue (batch tested with PRs 46738, 48827, 48831)

Moving disruption controller e2es to workload/

Based on #45301
Moving to track sig-apps in a single directory

cc @kubernetes/sig-contributor-experience-misc @kubernetes/sig-apps-misc @erictune @kow3ns @crimsonfaith91
2017-07-12 16:00:09 -07:00
Kubernetes Submit Queue
78aebb01d2 Merge pull request #46738 from bdbauer/mysql
Automatic merge from submit-queue

StatefulSet upgrade test - replicated database (mysql)

**What this PR does / why we need it**:
Adds a new upgrade test. The test creates a statefulset with a replicated mysql database. It populates the database and then continually polls the data while performing an upgrade. 

Ultimately, this PR increases confidence of reliability during upgrades. It helps show that StatefulSets and Pod Disruption Budgets are doing what they're supposed to.  Code to pay attention to this was added for #38336.

Also vendors in a golang mysql client driver, for use in the test.

**Release note**:
```release-note
NONE
```
2017-07-12 15:41:35 -07:00
Kubernetes Submit Queue
e8230c7186 Merge pull request #48817 from pwittrock/master
Automatic merge from submit-queue (batch tested with PRs 48781, 48817, 48830, 48829, 48053)

Move kubectl e2e tests to their own directory and prefix the test nam…

```release-note
NONE
```
2017-07-12 15:11:11 -07:00
Kubernetes Submit Queue
e1cd6315d7 Merge pull request #48781 from rmmh/sig-storage
Automatic merge from submit-queue

Make storage e2e tests start with [sig-storage] instead of [k8s.io].

This makes understanding sig ownership from a test name very easy for
tools and humans.

- Use a SIGDescribe helper function that adds a [sig-storage] prefix instead of [k8s.io] for tests in storage/
- Move a test that should be in storage into storage.
- Make tests owned by multiple SIGs (configmap test) have [sig-storage] instead of [Volume] labels.

This means that all tests that sig-storage directly owns can be found with a simple regex.

/cc @kubernetes/sig-storage-pr-reviews 

**What this PR does / why we need it**:
This will be used to make a testgrid dashboard for sig-storage.

**Release note**:
```release-note
NONE
```

Issue #48779
2017-07-12 14:57:15 -07:00
Yang Guo
b17c6a1769 Add test image name to the OS image field of the perf metrics 2017-07-12 14:51:45 -07:00
Kubernetes Submit Queue
77b6b126cb Merge pull request #48641 from smarterclayton/refactor_exec
Automatic merge from submit-queue (batch tested with PRs 48594, 47042, 48801, 48641, 48243)

Prepare to introduce websockets for exec and portforward

Refactor the code in remotecommand to better represent the structure of
what is common between portforward and exec.

Ref #48633
2017-07-12 14:08:10 -07:00
Anirudh
2d4529db4e Moving disruption controller e2es to workload/ 2017-07-12 14:06:06 -07:00
Maru Newby
228ab0d882 fed: Move namespace propagation to the sync controller 2017-07-12 13:54:24 -07:00
Maru Newby
7e772ee3eb fed: Provide client config to adapter factory
This will allow the namespace adapter to initialize a namespaced
resource deleter.
2017-07-12 13:54:24 -07:00
Mike Danese
dafad706af scheduler e2e: make container name shorter 2017-07-12 11:30:57 -07:00
Ryan Hitchman
a79ab6898b Move empty_dir_wrapper.go into the storage directory. 2017-07-12 11:14:13 -07:00
Ryan Hitchman
cb0f5b8693 Change [Volume] tags to [sig-storage]. 2017-07-12 11:11:16 -07:00
Ryan Hitchman
678ca905d6 Remove volume tags. 2017-07-12 11:11:16 -07:00
Ryan Hitchman
d4dc49ba90 Make storage e2e tests start with [sig-storage] instead of [k8s.io].
This makes understanding sig ownership from a test name very easy for
tools and humans.
2017-07-12 11:11:16 -07:00
Kubernetes Submit Queue
fc4f1c43ac Merge pull request #48619 from marun/fed-remove-redundant-e2e-2
Automatic merge from submit-queue (batch tested with PRs 48425, 41680, 48457, 48619, 48635)

[Federation] Remove redundant e2e

Now that federation of replicasets and deployments is implemented with the sync controller, the previous crud e2e duplicates coverage provided by the crudtester integration and e2e testing.

cc: @kubernetes/sig-federation-pr-reviews
2017-07-12 10:57:19 -07:00
Phillip Wittrock
2b5b4d26ae Move kubectl e2e tests to their own directory and prefix the test names with [sig-cli] 2017-07-12 09:42:06 -07:00
Kubernetes Submit Queue
8e5584fe95 Merge pull request #48482 from jianglingxia/jlx0705
Automatic merge from submit-queue (batch tested with PRs 48405, 48742, 48748, 48571, 48482)

Remove unused parameter

**What this PR does / why we need it**:

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2017-07-12 08:05:25 -07:00
Kubernetes Submit Queue
8e9186a53a Merge pull request #48730 from shyamjvs/reposition-scale-tests
Automatic merge from submit-queue

Move performance tests to test/e2e/scalability subdirectory

Following the move to make e2e tests more organized and accountable to the respective SIGs.

cc @kubernetes/sig-scalability-pr-reviews @wojtek-t @gmarek @grodrigues3
2017-07-12 05:41:23 -07:00
Shyam Jeedigunta
5f8cb3d9ff Enable logexporter mechanism to dump logs from k8s nodes to GCS directly 2017-07-12 14:39:49 +02:00
Kubernetes Submit Queue
0e461035cb Merge pull request #48734 from tallclair/namechange
Automatic merge from submit-queue (batch tested with PRs 48698, 48712, 48516, 48734, 48735)

Name change: s/timstclair/tallclair/

I changed my name, and I'm migrating my user name to be consistent.
2017-07-12 04:56:32 -07:00
Shyam Jeedigunta
0c75dd22f8 Move performance tests to test/e2e/scalability subdirectory 2017-07-12 12:08:26 +02:00
Kubernetes Submit Queue
de30789bf5 Merge pull request #48598 from gmarek/metrics
Automatic merge from submit-queue (batch tested with PRs 46865, 48661, 48598, 48658, 48614)

Move metrics_grabbert to test/e2e

cc @aleksandra-malinowska
2017-07-12 03:02:19 -07:00
Kubernetes Submit Queue
172df7e23d Merge pull request #46865 from sttts/sttts-kube-apiserver-run-test
Automatic merge from submit-queue

kube-apiserver: tests for aggregation and CRDs via delegation

In our integration tests we do not use the real kube-apiserver setup code, but mock our own. Here I use the actual `cmd/kube-apiserver/app.Run()` func with an testing etcd server. This can test the whole delegation chain of aggregator, apiextensions and kube-apiserver.
2017-07-12 02:55:15 -07:00
Kubernetes Submit Queue
b66be98174 Merge pull request #39173 from caesarxuchao/include-leaderelection
Automatic merge from submit-queue (batch tested with PRs 47232, 48625, 48613, 48567, 39173)

Include leaderelection in client-go; 

Fix #39117
Fix https://github.com/kubernetes/client-go/issues/28

This PR:
* includes the leaderelection to the staging client-go
* to avoid conflict with golang's testing package, renames package /testing to /testutil, and renames cache/testing to cache/testframework

```release-note
client-go now includes the leaderelection package
```
2017-07-12 00:10:20 -07:00
Dr. Stefan Schimanski
5835cfbcce kube-apiserver: add integration test with real Run() func
- for simple Run()
- for aggregation API group priorities
- for CRD creation
2017-07-12 08:47:25 +02:00
Dr. Stefan Schimanski
1a714f377c integration-tests: remove unneeded post hook wait workaround 2017-07-12 08:47:25 +02:00
jianglingxia
2d55962c85 squash the commits into one 2017-07-11 16:59:38 +08:00
Tim Allclair
a2f2e1d491 Name change: s/timstclair/tallclair/ 2017-07-10 14:05:46 -07:00
Benjamin Bauer
73bb5bfb12 Adds statefulset replicated sql upgrade test. Relies on image code that lives elsewhere. 2017-07-10 13:49:47 -07:00
Cao Shufeng
0c577c47d5 Use glog.*f when a format string is passed
ref:
https://godoc.org/github.com/golang/glog

I use the following commands to search all the invalid usage:
$ grep "glog.Warning(" * -r | grep %
$ grep "glog.Info(" * -r | grep %
$ grep "glog.Error(" * -r | grep %
$ grep ").Info(" * -r | grep % | grep "glog.V("
2017-07-10 19:04:03 +08:00
Kubernetes Submit Queue
8d42a34ccd Merge pull request #48597 from crassirostris/sd-logging-e2e-fix-soak
Automatic merge from submit-queue (batch tested with PRs 47040, 48597, 48608, 48653)

Fix Stackdriver Logging e2e soak tests

Start reading logs in parallel with running pods in soak tests

Fixed https://github.com/kubernetes/kubernetes/issues/48606
2017-07-08 15:33:24 -07:00
Kubernetes Submit Queue
a2e463f6d0 Merge pull request #48546 from deads2k/tpr-19-ripples
Automatic merge from submit-queue (batch tested with PRs 48497, 48604, 48599, 48560, 48546)

remove dead code

This removes the dead code cruft since we stopped serving TPRs.

ref #48152
2017-07-08 07:09:38 -07:00
Kubernetes Submit Queue
d4881dd491 Merge pull request #48560 from nicksardo/gce-network-project
Automatic merge from submit-queue (batch tested with PRs 48497, 48604, 48599, 48560, 48546)

GCE: Use network project id for firewall/route mgmt and zone listing

- Introduces a new environment variable for plumbing the network project id which will be used for firewall and route management. fixes #48515
- onXPN is determined by metadata if config is not specified
- Split `if` conditions: fixes #48521
- Remove `getNetworkNameViaAPICall` which was used as a last resort for the `networkURL` (if empty) which was previously filled with the metadata network project & name.

**Release note**:
```release-note
NONE
```
2017-07-08 07:09:36 -07:00
Kubernetes Submit Queue
b4e7628af1 Merge pull request #47329 from zhangxiaoyu-zidif/delete-meaningless-funcion-return
Automatic merge from submit-queue

Delete unused return

**What this PR does / why we need it**:
We do not use the function return, it's better not to write the return.

**Release note**:

```release-note
NONE
```
2017-07-08 02:46:43 -07:00
Chao Xu
24d5279c59 move leaderelection package to client-go 2017-07-07 17:01:04 -07:00
Clayton Coleman
12c7874c0d
Prepare to introduce websockets for exec and portforward
Refactor the code in remotecommand to better represent the structure of
what is common between portforward and exec.
2017-07-07 18:22:51 -04:00
Kubernetes Submit Queue
4f8d9af1db Merge pull request #48374 from mml/etcd-node-test
Automatic merge from submit-queue (batch tested with PRs 48374, 48524, 48519, 42548, 48615)

Add a node upgrade test for etcd statefulset with a PDB.

Tests for #38336
2017-07-07 14:48:27 -07:00
Kubernetes Submit Queue
823f31ec91 Merge pull request #47713 from ravisantoshgudimetla/scheduler_perf_test_fix
Automatic merge from submit-queue

Small fix for number of pods and nodes in test function

**What this PR does / why we need it**:
Small fix to have correct pods and nodes in test function.
**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:
Scheduler perf, nodes and pods number fix for 100 nodes 3k pods.
**Release note**:

```release-note
NONE
```
2017-07-07 13:04:41 -07:00
Maru Newby
df5e8fc974 fed: Remove redundant deployment e2e tests
Now that federation of deployments is implemented with the sync
controller, the existing e2e coverage duplicates that provided by the
crudtester integration and e2e testing.
2017-07-07 10:58:51 -07:00
Maru Newby
4f0d2638fd fed: Remove redundant replicaset e2e
Now that replicaset federation is implemented with the sync
controller, the old replicaset-specific e2e tests duplicate coverage
provided by crudtester integration and e2e testing.
2017-07-07 10:58:51 -07:00
Mik Vyatskov
01df7090cb Fix Stackdriver Logging e2e soak tests 2017-07-07 15:18:51 +02:00
deads2k
0801ded425 remove dead code 2017-07-07 09:12:29 -04:00
gmarek
55880e6b4b Move metrics_grabbert to test/e2e 2017-07-07 13:13:44 +02:00
Nick Sardo
06e328627c Use network project id for firewall/route mgmt and zone listing 2017-07-06 16:58:27 -07:00
Kubernetes Submit Queue
aef4010592 Merge pull request #46228 from jayunit100/scheduler_perf_owners
Automatic merge from submit-queue

Add ownership for the future of scheduler_perf and kubemark

**What this PR does / why we need it**:

The scheduler_perf project is cross-cutting with the other goals of the performance and scale initiatives, so, I've put together a list of interested parties who have been running, using, and contributing to it.

cc @kubernetes/sig-scheduling-pr-reviews @ravisantoshgudimetla @sjug
2017-07-06 10:02:21 -07:00
Kubernetes Submit Queue
20e629b1c6 Merge pull request #44394 from rthallisey/pre-existing-provider
Automatic merge from submit-queue

Launch kubemark with an existing Kubemark master

In order to expand the use of kubemark, allow developers to use kubemark with a pre-existing Kubernetes cluster.

Ref issue  #44393
2017-07-06 04:41:53 -07:00
Kubernetes Submit Queue
afc67bdb6c Merge pull request #48309 from MrHohn/e2e-fix-ingress-tag
Automatic merge from submit-queue

[e2e-ingress] Get node tag from instance under GKE

**What this PR does / why we need it**: Making ingress CI green again.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #48167 

**Special notes for your reviewer**:
/assign @nicksardo 

**Release note**:

```release-note
NONE
```
2017-07-05 15:10:16 -07:00
Zihong Zheng
532a9d78ad [e2e-ingress] Get node tags from instance under GKE 2017-07-05 13:07:38 -07:00
Kubernetes Submit Queue
cfde9e5832 Merge pull request #48444 from p0lyn0mial/add_fisher_resource_to_wardle_group
Automatic merge from submit-queue (batch tested with PRs 47162, 48444, 48445)

Introducing a cluster-scoped resource in the wardle.k8s.io group.

**What this PR does / why we need it**:
This PR adds a cluster-scoped resource to the wardle.k8s.io group.
The cluster scoped resource has a field that indicates Flunder.Names that are disallowed.
The resource is going to be used by an admission plugin.
The admission plugin will list the cluster-scope resources and check against banned names.

**Special notes for your reviewer**:
Issue: #47868

**Release note**:

```
NONE
```
2017-07-05 06:39:29 -07:00
Manjunath A Kumatagi
5447ec97f0 Move test-webserver from contrib/for-demos to kubernetes/test/images 2017-07-05 18:55:40 +05:30
Ryan Hallisey
f9354bf6b7 Add a README to the pre-existing provdier 2017-07-05 09:14:58 -04:00
Ryan Hallisey
82e1d208f6 Launch kubemark with an existing Kubemark Master
In order to expand the use of kubemark, allow developers to
use kubemark with a pre-existing Kubemark master.
2017-07-05 09:14:53 -04:00
Kubernetes Submit Queue
c10cc3decd Merge pull request #48353 from deads2k/tpr-17-delete-01
Automatic merge from submit-queue (batch tested with PRs 48480, 48353)

remove tpr api access

xref https://github.com/kubernetes/kubernetes/issues/48152

TPR tentacles go pretty deep. This gets us started by removing API access and we'll move down from there.

@kubernetes/sig-api-machinery-misc 
@ironcladlou this should free up the GC implementation since TPRs will no longer be present and failing.

```release-note
Removing TPR api access per https://github.com/kubernetes/kubernetes/issues/48152
```
2017-07-05 05:49:30 -07:00
Kubernetes Submit Queue
c746680143 Merge pull request #47384 from shiywang/api403
Automatic merge from submit-queue (batch tested with PRs 48383, 47384)

Fix 401/403 apiserver errors do not return 'Status' objects

fixes https://github.com/kubernetes/kubernetes/issues/45970
2017-07-05 02:18:21 -07:00
Kubernetes Submit Queue
9a82cb2059 Merge pull request #48448 from shyamjvs/fix-configmap-test
Automatic merge from submit-queue (batch tested with PRs 47043, 48448, 47515, 48446)

Fix secret/configmap/projected volume update tests to work for large clusters

Fixes https://github.com/kubernetes/kubernetes/issues/48359

/cc @kubernetes/sig-node-pr-reviews @wojtek-t @gmarek
2017-07-04 09:12:23 -07:00
Kubernetes Submit Queue
3f6124f185 Merge pull request #48468 from aleksandra-malinowska/autoscaling-volumes-test-fix
Automatic merge from submit-queue (batch tested with PRs 46926, 48468)

Fix typo in cluster size autoscaling tests selector

This caused tests not to be run automatically
2017-07-04 06:56:24 -07:00
p0lyn0mial
113e9ba1d3 Introducing a cluster-scoped resource in the wardle.k8s.io group.
The cluster scoped resource has a field that indicates Flunder.Names that are disallowed.
The resource is going to be used by an admission plugin.
The admission plugin will list the cluster-scope resources and check against banned names.

Issue: #47868
2017-07-04 15:43:45 +02:00
Shyam Jeedigunta
b5b4ba8fec Fix secret/configmap/projected update tests to work for large clusters 2017-07-04 14:14:15 +02:00
Aleksandra Malinowska
933b2efdcf fix test selector 2017-07-04 14:01:07 +02:00