Commit Graph

465 Commits

Author SHA1 Message Date
Kubernetes Prow Robot
a99d6cef86
Merge pull request #72729 from bclau/tests/split-dns-host-entries
tests: Separates DNS hosts entries test
2019-02-26 06:38:10 -08:00
jennybuckley
8101b86ac4 Promote aggregator e2e test to conformance 2019-02-15 11:04:38 -08:00
Claudiu Belu
cb9c594f98 tests: Separates DNS hosts entries test
At the moment, Windows cannot mount individual files into Containers, which means
that the Kubelet-managed hosts file cannot be mounted into the Container, causing
the "should provide DNS for the cluster" test to fail.

This test separates the hosts entries checks from the mentioned test to a new test.
2019-02-06 15:41:57 -08:00
Roy Lenferink
b43c04452f Updated OWNERS files to include link to docs 2019-02-04 22:33:12 +01:00
globervinodhn
a2078bd4af Promote empty-key ConfigMap e2e to Conformance 2019-01-29 15:41:27 +05:30
Justin SB
19a5528a65
Remove executable permission from testdata 2019-01-03 12:21:31 -05:00
Aaron Crickenberger
ec2ba35662 Add new reviewers for conformance
Put into OWNERS files what has effectively been happening
for the past few months, we review and shepherd PR's
through other SIG reviewers before bringing to sig-arch
for a final /approve.

The goal is to eventually grow approvers when it's been
demonstrated that we have sufficient context.
2018-11-02 21:47:32 -07:00
k8s-ci-robot
77fd16e0e7
Merge pull request #69266 from SataQiu/fix-20180930
Remove the redundant space
2018-11-02 08:38:37 -07:00
SataQiu
c9bc625428 Remove the redundant space 2018-11-02 15:45:11 +08:00
pontiyaraja
b81936320b Promote Replication Controller and Replica Set e2e tests to Conformance 2018-11-01 00:20:04 +05:30
Aaron Crickenberger
a188653334 Add myself as reviewer to test/conformance/OWNERS
I'd like to start fielding more reviews of this code since I'm actively
involved in efforts that are consumers of it
2018-10-29 15:48:00 -07:00
k8s-ci-robot
1ba56437d9
Merge pull request #69673 from dims/add-labels-when-conformance-directory-changes
Add labels when conformance/ directory changes
2018-10-13 07:37:32 -07:00
Davanum Srinivas
744b8c1694
Add labels when conformance/ directory changes
So we don't have to do this manually for every PR

Change-Id: I4dc656e84ff6c48bc582b2aee6615bef11553257
2018-10-11 07:18:07 -04:00
Michelle Au
17c0e9f7ea Update build and conformance test list 2018-10-09 14:27:58 -07:00
k8s-ci-robot
321313b19e
Merge pull request #69004 from mgdevstack/master-pods-websocket-conformance
Promote pod's websocket based NodeConformance tests to Conformance
2018-10-08 22:28:12 -07:00
k8s-ci-robot
a34123d9c3
Merge pull request #67901 from dims/drop-flaky-test-from-conformance
Remove conformance tag from flaky test
2018-10-08 19:24:58 -07:00
k8s-ci-robot
766d860f86
Merge pull request #69021 from mgdevstack/master-kubelet-conformance
Promote kubelet NodeConformance tests to Conformance
2018-10-04 18:19:25 -07:00
Mayank Gaikwad
78a15ed1c9 Promote pod's websocket based NodeConformance tests to Conformance 2018-09-30 21:57:49 +05:30
k8s-ci-robot
1e4edac012
Merge pull request #68886 from mgdevstack/master-emptydir-wrapper
Promote emptyDir wrapper volumes tests to Conformance
2018-09-26 20:37:47 -07:00
Mayank Gaikwad
696c9ea0b1 Promote kubelet NodeConformance tests to Conformance 2018-09-25 08:54:20 +05:30
Mayank Gaikwad
b9942796db Promote emptyDir wrapper volume tests to conformance 2018-09-24 15:39:20 +05:30
Mayank Gaikwad
8b0a5950ab Promote non-table based container runtime test to conformance 2018-09-20 18:59:59 +05:30
Davanum Srinivas
ab2d66fd75
Remove conformance tag from flaky test
We should not have potentially flaky tests in conformance test suite

Change-Id: I83588667f59a0a7c07db39fe596b7d952c1d543b
2018-08-30 09:10:37 -04:00
Kubernetes Submit Queue
99fab84c7a
Merge pull request #67100 from mkurylec/promotion-lifecycle-hook-to-conformance
Automatic merge from submit-queue (batch tested with PRs 67100, 67426). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

porting e2e_node lifecycle testcases into e2e folder under common

a) Shifted (and renamed) file existing in e2e_node to e2e/common.
b) Added these tests to the conformance suite:
- "should execute poststart exec hook properly"
-  "should execute prestop exec hook properly"
- "should execute poststart http hook properly"
- "should execute prestop http hook properly"

[reference issue](https://github.com/kubernetes/kubernetes/issues/67086) explaining the effort.
2018-08-16 11:57:28 -07:00
Kubernetes Submit Queue
f9d63000a3
Merge pull request #67071 from mgdevstack/master-secretvolume-nodeconformance
Automatic merge from submit-queue (batch tested with PRs 67071, 66906, 66722, 67276, 67039). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Promoting "[sig-storage] Secrets should be able to mount in a volume regardless of a different secret existing with same name in different namespace" to Conformance

**What this PR does / why we need it**:
An consolidated effort to resolve the issue https://github.com/kubernetes/kubernetes/issues/66875
> _[sig-storage] Secrets   should be able to mount in a volume regardless of a different secret existing with same name in different namespace_

Promoting mentioned e2e test for Conformance as it -
- Validates that secret with same name can be created in different namespaces but secrets which reside in same namespace as that of pod can be only be accessed from volume mounted in the container.
- Improves api coverage including prioritized Pod API lists. https://github.com/cncf/k8s-conformance/issues/220#issuecomment-393344061

> GET /api/v1/namespaces/{namespace}/pods/{name}/log
GET /api/v1/namespaces/{namespace}/pods
GET /api/v1/namespaces/{namespace}/pods/{name}
POST /api/v1/namespaces/{namespace}/pods
PUT /api/v1/namespaces/{namespace}/pods/{name}/status
DELETE /api/v1/namespaces/{namespace}/pods
DELETE /api/v1/namespaces/{namespace}/pods/{name}

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
No Flakes Found.
```
• [SLOW TEST:16.326 seconds]
[sig-storage] Secrets
/home/vagrant/go-workspace/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/secrets_volume.go:33
  should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance]
  /home/vagrant/go-workspace/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/secrets_volume.go:86
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
Aug  7 07:12:44.133: INFO: Running AfterSuite actions on all node
Aug  7 07:12:44.134: INFO: Running AfterSuite actions on node 1

Ran 1 of 1020 Specs in 16.441 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 1019 Skipped PASS

All tests passed...
Will keep running them until they fail.
This was attempt #40
No, seriously... you can probably stop now.
```

**Release note**:

```release-note
NONE
```
/area conformance
@kubernetes/sig-node-pr-reviews
2018-08-14 22:43:15 -07:00
Kubernetes Submit Queue
6cc7b1cd3a
Merge pull request #66969 from mgdevstack/master-configmap-bindata-nodeconformance
Automatic merge from submit-queue (batch tested with PRs 61212, 66369, 66446, 66895, 66969). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Promoting configmap binarydata support [NodeConformance] test to conformance

**What this PR does / why we need it**:

**e2e:** _[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance]_
Promotes mentioned e2e to conformance as it -
1. Validates ConfigMap's binarydata support effectively
2. Improves API Coverage for prioritized api lists. (https://github.com/cncf/k8s-conformance/issues/220#issuecomment-393344061)

> GET /api/v1/namespaces/{namespace}/pods
GET /api/v1/namespaces/{namespace}/pods/{name}
GET /api/v1/namespaces/{namespace}/pods/{name}/log
POST /api/v1/namespaces/{namespace}/pods
PUT /api/v1/namespaces/{namespace}/pods/{name}/status
DELETE /api/v1/namespaces/{namespace}/pods
DELETE /api/v1/namespaces/{namespace}/pods/{name}

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
No Flakes found.

**Release note**:

```release-note
NONE
```
/area conformance
@kubernetes/sig-node-pr-reviews
2018-08-14 21:18:19 -07:00
Maria Alejandra Kurylec
95a6dc4f33 a) fixing rebase 2018-08-08 11:06:07 -03:00
Maria Alejandra Kurylec
f79d5a19d4 a) porting e2e_node lifecycle testcases into e2e folder, under common.
b) placing them under conformance golden list.
2018-08-08 09:44:05 -03:00
Kubernetes Submit Queue
81c6b735fa
Merge pull request #67084 from spiffxp/rm-conformance-from-e2e_node
Automatic merge from submit-queue (batch tested with PRs 63572, 67084). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove [Conformance] from tests in test/e2e_node

Conformance tests live inside of test/e2e, none of the tests currently
tagged as `[Conformance]` in test/e2e_node actually get run when you run
the conformance tests with e2e.test (either directly or indirectly with
sonobuoy)

If these tests make sense as both `[NodeConformance]` and `[Conformance]`
tests, they should be ported to test/e2e/common

/kind cleanup
/area conformance
/sig architecture
/cc @bgrant0607 @smarterclayton @timothysc
/sig node
/cc @yujuhong

ref: https://github.com/kubernetes/kubernetes/issues/66875

```release-note
NONE
```
2018-08-07 21:06:04 -07:00
Kubernetes Submit Queue
71b074ff0a
Merge pull request #66634 from janetkuo/deploy-conform
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Add Deployment conformance tests

**What this PR does / why we need it**:

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**: @kubernetes/sig-apps-pr-reviews @kubernetes/sig-architecture-pr-reviews 

**Release note**:

```release-note
NONE
```
2018-08-07 18:17:30 -07:00
Aaron Crickenberger
27d215c58f Change BUILD to remove e2e_node as a reference 2018-08-07 10:44:03 -07:00
Aaron Crickenberger
6ae4c03fb7 Run :list_conformance_tests without updating BUILD 2018-08-07 10:44:02 -07:00
Mayank Gaikwad
99a37913c0 promoting overlapping secret in different namespaces NodeConformance test to conformance. 2018-08-07 15:36:06 +05:30
Mayank Gaikwad
e2a4cd1cce promoting configmap binarydata support NodeConformance test to conformance. 2018-08-07 09:18:31 +05:30
Kubernetes Submit Queue
1b033f64a1
Merge pull request #66921 from mgdevstack/NodeConformance-InitContainer
Automatic merge from submit-queue (batch tested with PRs 58058, 67033, 66921, 66956). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Promoting InitContainer [NodeConformance] e2e tests for Conformance

**What this PR does / why we need it**:

1. Promotes mentioned 4 InitContainer [NodeConformance] tests for Conformance
2. Validates different PodPhases effectively
3. Improves API coverage mentioned in #66124 .

E2E tests -
1. InitContainer [NodeConformance] should invoke init containers on a RestartNever pod
2. InitContainer [NodeConformance] should invoke init containers on a RestartAlways pod
3. InitContainer [NodeConformance] should not start app containers if init containers fail on a RestartAlways pod
4. InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #66124 

**Special notes for your reviewer**:


**Release note**:

```release-note
NONE
```
/area conformance
@kubernetes/sig-node-pr-reviews
2018-08-06 17:01:11 -07:00
Mayank Gaikwad
33fc389a91 added new conforamnce test under NodeConformance verifying InitContainer PodSpec and improves api coverage 2018-08-02 23:15:52 +05:30
Maria Alejandra Kurylec
e254126f02 a) promoting "Atomic Writer volume" testcases 2018-08-02 13:58:36 -03:00
Janet Kuo
4eb583c2b1 Add Deployment conformance tests 2018-07-25 17:15:27 -07:00
Mayank Gaikwad
f2484bbfd8 promoting namespace e2e tests for conformance 2018-06-19 16:05:44 +05:30
jennybuckley
7a1b8eaae3 Promote watch e2e test to conformance 2018-05-30 00:13:57 -07:00
Yu-Ju Hong
1816d4eca4 conformance: normalize the test names
To detect whether conformance tests have been changed, the test
argument with the `ConformanceIt` is recorded to conformance.txt.
This change remove additional tags (e.g., [Feature:]) and trim spaces,
so that the detection is less-prone to noise.

This change also updates conformance.txt with normalized names.
2018-05-23 12:49:31 -07:00
Kubernetes Submit Queue
b5f61ac129
Merge pull request #62657 from matthyx/master
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Update all script shebangs to use /usr/bin/env interpreter instead of /bin/interpreter

This is required to support systems where bash doesn't reside in /bin (such as NixOS, or the *BSD family) and allow users to specify a different interpreter version through $PATH manipulation.
https://www.cyberciti.biz/tips/finding-bash-perl-python-portably-using-env.html
```release-note
Use /usr/bin/env in all script shebangs to increase portability.
```
2018-05-02 19:44:32 -07:00
Matthias Bertschy
9b15af19b2 Update all script to use /usr/bin/env bash in shebang 2018-04-19 13:20:13 +02:00
Davanum Srinivas
fff9684823 A test we always skip should not be a conformance test 2018-04-10 09:12:10 -04:00
Kenneth Owens
dcc3d25618 Adds daemonset conformance tests 2018-02-28 12:43:02 -08:00
Kubernetes Submit Queue
6546b69964
Merge pull request #60116 from jennybuckley/gc-conf-test
Automatic merge from submit-queue (batch tested with PRs 60430, 60115, 58052, 60355, 60116). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Add Garbage Collector e2e conformance tests

**What this PR does / why we need it**:
The garbage collector is a core component of kubernetes and needs to be tested by conformance, so its functionality can be relied on in any kubernetes environment.

As we can see in [testgrid](https://k8s-testgrid.appspot.com/sig-api-machinery#gce), the garbage collector tests being promoted by this PR are consistently passing. And the intention to promote them to conformance tests was laid out by [this document](https://docs.google.com/document/d/1h2S9ff9N-4MKqfayE3A8TqjD_qIwuND_dAhOAJFxYS0)

**Special notes for your reviewer**:
The last two tests in this file are not added as conformance tests because they involve beta features (custom resources and cronjobs), and conformance tests are only allowed for features in GA.

**Release note**:
```release-note
New conformance tests added for the Garbage Collector
```
2018-02-27 09:38:51 -08:00
jennybuckley
e6f867d2ca promote GC e2e tests to conformance tests 2018-02-26 11:18:12 -08:00
Anthony Yeh
1e82d1399c
Conformance: Add StatefulSet tests. 2018-02-25 17:04:53 -08:00
Mike Danese
7b4722964d remove deprecated /proxy paths
These were depercated in v1.2.
2018-02-20 14:42:19 -08:00
Jeff Grafton
ef56a8d6bb Autogenerated: hack/update-bazel.sh 2018-02-16 13:43:01 -08:00
Di Xu
48388fec7e fix all the typos across the project 2018-02-11 11:04:14 +08:00
Srini Brahmaroutu
fa51acbda3 Create Conformance document to display all tests that belong to Conformance suite 2018-01-15 14:17:48 -08:00
Jeff Grafton
efee0704c6 Autogenerate BUILD files 2017-12-23 13:12:11 -08:00
Cole Wagner
7b6a1d3e77 Fix conformance testdata OWNERS file. 2017-12-06 14:27:15 -08:00
Kubernetes Submit Queue
28e45f2895
Merge pull request #54035 from xiangpengzhao/combine-e2e-test
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Combine downward api e2e test cases.

**What this PR does / why we need it**:
This will reduce one loop of create/delete pod. Hope it can save some test time.

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2017-11-22 17:20:57 -08:00
xiangpengzhao
6318fcca85 Update BUILD file to include e2e_node tests 2017-11-17 17:28:29 +08:00
xiangpengzhao
025f946784 Update conformance testdata for e2e node conformance tests 2017-11-17 17:28:28 +08:00
xiangpengzhao
eddd9a208f Update conformance testdata for downward api test 2017-11-14 09:53:31 +08:00
Matt Liggett
3483447ebc Refer to instructions when the test fails. 2017-11-10 11:04:55 -08:00
Matt Liggett
13f3844ef5 Add README.md to test/conformance. 2017-11-10 11:02:11 -08:00
Matt Liggett
97e669abdf Disallow parent approvals. 2017-11-10 10:54:23 -08:00
guangxuli
7c7392014d update autogen BUILD files 2017-11-07 11:17:00 +08:00
xiangpengzhao
36fb117555 Update conformance testdata for storage test 2017-10-31 11:07:32 +08:00
Matt Liggett
6096d9d4a1 update-bazel 2017-10-27 15:31:29 -07:00
Matt Liggett
fad431118a Add conformance test regression test.
This test creates a golden list of existing conformance tests.  Efforts
to add or remove conformance tests will require you to rebuild the
golden list, and changes to the golden list will be reviewed by
sig-architecture.
2017-10-27 15:31:20 -07:00