Commit Graph

189 Commits

Author SHA1 Message Date
Jordan Liggitt
8111bb3d77 Update wardle e2e image 2019-12-16 11:06:11 -05:00
Jefftree
4d3d364d2b promote e2e tests for taint-tolerations in predicates 2019-12-05 16:54:02 -08:00
Aaron Crickenberger
3cbc07bb64 Promote a TCP probe test to Conformance 2019-11-21 12:12:58 -08:00
Dr. Stefan Schimanski
69282dc4d8 e2e: promote CRD defaulting test to conformance test 2019-11-15 15:19:45 +01:00
John Belamaric
3d745c4ad4 Add johnbelamaric as conformance code reviewer/approver 2019-11-12 13:51:16 -08:00
Jefftree
fd7eaffd99 kubetestgen implementation 2019-11-08 15:40:22 -08:00
John Belamaric
c0e6a8704c Add conformance-behavior-approvers to OWNERS_ALIASES 2019-10-29 11:24:06 -07:00
Timothy St. Clair
97055841b1 Audit of test/* OWNERS files 2019-10-10 15:52:51 -05:00
Kubernetes Prow Robot
c449359119
Merge pull request #74977 from mgdevstack/master-conformance-pqdn
Promote DNS e2e verifying PQDN resolution for cluster
2019-09-26 14:39:36 -07:00
Kubernetes Prow Robot
c0ad143f64
Merge pull request #82632 from wojtek-t/node_lease_conformance
Promote lease API test to Conformance
2019-09-26 13:02:49 -07:00
John Schnake
d0ab1f06fb Allow disruptive conformance tests and marks 2
- Adjusts tooling to allow disrutpive tests to be marked conformance
 - Updates the corresponding tests
 - Marks 2 tests as disruptive
2019-09-24 14:17:37 -05:00
wojtekt
4ec66c842e Promote lease API test to Conformance 2019-09-12 19:58:04 +02:00
John Belamaric
84070403da Add johnbelamaric as conformance approver 2019-09-11 12:36:13 -07:00
Mayank Gaikwad
eb07002d41 Promote PQDN for services DNS e2e to Conformance 2019-09-06 02:14:46 +05:30
Haowei Cai
fd68c41e42 promote crd discovery e2e to conformance 2019-08-30 14:07:19 -07:00
Kubernetes Prow Robot
1e6686e6af
Merge pull request #81864 from jpbetz/crd-conformance
Promote CRD e2e tests to conformance
2019-08-29 19:55:59 -07:00
Joe Betz
68bafe4404 Promote admission webhook e2e tests to conformance 2019-08-29 13:50:14 -07:00
Joe Betz
c7919e64ff Promote CRD e2e tests to conformance 2019-08-29 11:50:24 -07:00
Kubernetes Prow Robot
56aded4db0
Merge pull request #81721 from mattjmcnaughton/mattjmcnaughton/close-open-files-in-conformance
Close leaking files in `conformance/walk.go`
2019-08-23 00:51:45 -07:00
mattjmcnaughton
f7128535bd
Close leaking files in conformance/walk.go
We want to ensure we close this file handler if it was opened
successfully.
2019-08-21 08:59:35 -04:00
Mayank Gaikwad
7c64fc9d98 Promote e2e verifying service type updates 2019-08-14 16:07:59 +05:30
Kubernetes Prow Robot
9d3d20114a
Merge pull request #78331 from mgdevstack/master-promote-resourcequota
Promote resourceQuota e2e verifying 'object count quota' and 'quota scope' to Conformance
2019-08-08 17:57:25 -07:00
Kubernetes Prow Robot
cc4301025d
Merge pull request #80655 from johnbelamaric/promote-nodeport-creation
Promote NodePort service creation e2e test to conformance
2019-08-06 23:56:50 -07:00
John Belamaric
60a51ce020 Promote NodePort service creation e2e test to conformance 2019-08-06 16:23:40 -07:00
Aaron Crickenberger
e0750bd8db Promote taint-based eviction e2e tests to Conformance 2019-07-26 11:50:25 -07:00
Kubernetes Prow Robot
9e4b126e18
Merge pull request #80550 from spiffxp/promote-jobs-complete-after-restart
Promote job completion after failure e2e test to Conformance
2019-07-25 22:35:58 -07:00
Kubernetes Prow Robot
8497639221
Merge pull request #80544 from spiffxp/promote-jobs-adopt-release-orphan-pods
Promote job pod orphaning/adotion e2e test to Conformance
2019-07-25 20:48:36 -07:00
Kubernetes Prow Robot
2321d1e9e8
Merge pull request #80150 from ii/promote-statefulset-replica-scaling
Promote StatefulSet Replica scaling
2019-07-25 16:02:07 -07:00
Mayank Gaikwad
a921970745 Promote resourceQuota e2e verifying 'object count quota' and 'quota scope' to Conformance 2019-07-25 20:01:35 +05:30
Aaron Crickenberger
e0b9d77609 Promote job completion after failure e2e test to Conformance 2019-07-24 17:17:07 -07:00
Aaron Crickenberger
275b7b2fa0 Promote job pod orphaning/adotion e2e test to Conformance 2019-07-24 16:28:10 -07:00
Kubernetes Prow Robot
65b094676f
Merge pull request #78350 from globervinodhn/hostip_hostport_promote
Promote existing E2Es for hostport/HostIP resolution to conformance
2019-07-19 14:25:24 -07:00
Caleb Woodbine
5db35e67ee Fix placement of test in conformance.txt 2019-07-16 21:36:55 +00:00
Caleb Woodbine
91da6fd565 Promote API metadata return value 2019-07-15 21:40:14 +00:00
Caleb Woodbine
a062367251 Promote StatefulSet Replica scaling 2019-07-15 02:02:39 +00:00
Kubernetes Prow Robot
f7f1b2d5f7
Merge pull request #72168 from brahmaroutu/conformance_hdr
Allow version field in the title to be changeable
2019-07-01 19:09:08 -07:00
Aaron Crickenberger
ffe70f1a6e Conformance walker should handle nested/adjacent Describes
This also revealed that the regex for Context was too generous and would
catch things like SecurityContext or ContextWithFoo(...) calls

This ensures that test suites with a ineligible tag in their top-level
Describe will be rejected from promotion to conformance
2019-06-25 21:41:38 -07:00
pontiyaraja
40146c85f4 re-named conformance test name for pod creating with CPU and memory resources 2019-06-17 14:54:08 +05:30
Kubernetes Prow Robot
16bc6c1d02
Merge pull request #74982 from mgdevstack/promote-dns-hostname
Promote DNS e2e verifying DNS resolution for hostname and subdomain
2019-06-13 19:13:11 -07:00
Kubernetes Prow Robot
62eae8d058
Merge pull request #70639 from mgdevstack/promote-security-context
Promote security context NodeConformance tests to Conformance suite
2019-06-13 17:48:20 -07:00
globervinodhn
faf5cda046 Promote existing E2Es for hostport/HostIP resolution to conformance 2019-06-06 11:39:27 +05:30
Aaron Crickenberger
67be4f5d06 Error on tests ineligible for promotion to conformance
If there are tags in the test name that describe qualities of the
test that make it ineligible for conformance, raise an error. This
is basically the "skip list" that heptio's e2e image used to use.

Thankfully all of our existing Conformance tests lack these tags. I
considered added [Slow] to the list, but let's save that for another
day.
2019-06-05 10:36:59 -07:00
Mayank Gaikwad
fc2af0e5a4 Promote e2e verifying DNS resolution for o pod's fqdn, hostname and subdomain 2019-05-14 23:53:00 +05:30
Kubernetes Prow Robot
f712c3ee0e
Merge pull request #77620 from johnbelamaric/add-to-conformance-reviewers
Add johnbelamaric as conformance test reviewer
2019-05-10 17:56:24 -07:00
Kubernetes Prow Robot
7f86cb140f
Merge pull request #72167 from brahmaroutu/conformance_context
Comment association to ConformanceIt block should be validated properly.
2019-05-08 20:12:48 -07:00
John Belamaric
4f3653f026 Add johnbelamaric as conformance test reviewer 2019-05-08 16:37:25 -07:00
Kubernetes Prow Robot
7faeee22b1
Merge pull request #77556 from spiffxp/add-spiffxp-to-conformance-code-approvers
Promote spiffxp to approver, add oomichi as reviewer
2019-05-07 22:15:10 -07:00
Srini Brahmaroutu
e9bab1c896 Allow version field in the title to be changeable 2019-05-07 15:05:04 -07:00
Aaron Crickenberger
8ee8b77eed Promote spiffxp to approver, add oomichi as reviewer 2019-05-07 12:11:36 -07:00
Srini Brahmaroutu
1cb5872cd3 Comment association to ConformanceIt block should be validated properly. 2019-05-07 09:16:44 -07:00
Srini Brahmaroutu
37e700050b Add Release information to each of the conformance tests. 2019-05-07 09:14:08 -07:00
Davanum Srinivas
7b8c9acc09
remove unused code
Change-Id: If821920ec8872e326b7d85437ad8d2620807799d
2019-04-19 08:36:31 -04:00
Kubernetes Prow Robot
03c5079ac1
Merge pull request #75134 from mgdevstack/promote-runtime-3
Promote container runtime e2e verifying termination message
2019-04-16 02:11:44 -07:00
Kubernetes Prow Robot
9217cb5b6e
Merge pull request #76350 from jpbetz/watch-consistency-conformance
Promote 'watch-consistency' e2e test to be a conformance test
2019-04-15 18:05:20 -07:00
Kubernetes Prow Robot
94a1458638
Merge pull request #76368 from SataQiu/cleanup-test-20190410
Cleanup command prompt for readme.md
2019-04-15 10:26:06 -07:00
Mayank Gaikwad
82822f10e1 Promote container runtime e2e verifying termination message 2019-04-15 16:37:18 +05:30
SataQiu
9f8ee74a52 cleanup command prompt for readme.md 2019-04-13 19:10:36 +08:00
Kubernetes Prow Robot
9aac5ced1f
Merge pull request #74702 from globervinodhn/secret_empty_promote
Promote empty secret key e2e test to conformance test
2019-04-12 21:38:02 -07:00
Kubernetes Prow Robot
2a6efd3fe7
Merge pull request #75473 from pontiyaraja/podCNF
promote pod should be submitted and removed e2e test case to conformance
2019-04-12 15:56:18 -07:00
Kubernetes Prow Robot
2d5f5a9da5
Merge pull request #75471 from pontiyaraja/sharedVolCNF
promote shared volumes between the container in a pod e2e to conformance
2019-04-12 15:56:04 -07:00
Kubernetes Prow Robot
cf76367f05
Merge pull request #75101 from mgdevstack/promote-runtime-2
Promote container runtime e2e having non default TerminationMessagePath set
2019-04-12 14:30:36 -07:00
Kubernetes Prow Robot
42b3d9d9f3
Merge pull request #74983 from mgdevstack/master-conformance-pqdn-externamesrv
Promote DNS e2e verifying DNS resolution for externalName services
2019-04-12 14:30:22 -07:00
Kubernetes Prow Robot
9c61764a07
Merge pull request #74892 from globervinodhn/rc_exceed_quota_promote
Promote exceed quota e2e test for Replication Controller to conformance test
2019-04-12 14:30:08 -07:00
Mayank Gaikwad
f7d8771dfe Promote security context NodeConformance tests to Conformance suite 2019-04-12 10:22:24 +05:30
Joe Betz
a6126dc55a Promote 'watch-consistency' e2e test to be a conformance test 2019-04-11 12:54:16 -07:00
Mayank Gaikwad
295f43b1fa Promote container runtime e2e verifying non-default termination message path 2019-04-04 07:09:17 +05:30
Mayank Gaikwad
8f5c3a2980 Promote DNS e2e verifying DNS resolution for externalName services 2019-03-27 10:45:59 +05:30
globervinodhn
a5f3e24ab7 promote empty secret key test to conformance: Version updated to v1.15 2019-03-23 16:07:50 +05:30
pontiyaraja
d46c56f384 promote should be submitted and removed e2e test case to conformance 2019-03-19 15:14:54 +05:30
pontiyaraja
584e00aa20 promote shared volumes between the container in a pod e2e to conformance 2019-03-19 14:39:40 +05:30
globervinodhn
c52a27f409 promote job deletion in the namespace e2e to conformance - version updated to v1.15 2019-03-12 12:44:59 +05:30
globervinodhn
6b8226327d Promote e2e failre test for rc check for exceeding pod quota to conformance - Version updated to v1.15 2019-03-12 12:41:39 +05:30
Kubernetes Prow Robot
d761fe8491
Merge pull request #72774 from globervinodhn/conformance-emptyconfigmapkey-addition
Promote emptyconfigmap key e2e test to conformance test
2019-02-28 20:36:07 -08:00
Kubernetes Prow Robot
caaad1be26
Merge pull request #72526 from justinsb/testdata_should_not_be_executable
Remove executable permission from testdata
2019-02-28 20:35:56 -08:00
Kubernetes Prow Robot
a99d6cef86
Merge pull request #72729 from bclau/tests/split-dns-host-entries
tests: Separates DNS hosts entries test
2019-02-26 06:38:10 -08:00
jennybuckley
8101b86ac4 Promote aggregator e2e test to conformance 2019-02-15 11:04:38 -08:00
Claudiu Belu
cb9c594f98 tests: Separates DNS hosts entries test
At the moment, Windows cannot mount individual files into Containers, which means
that the Kubelet-managed hosts file cannot be mounted into the Container, causing
the "should provide DNS for the cluster" test to fail.

This test separates the hosts entries checks from the mentioned test to a new test.
2019-02-06 15:41:57 -08:00
Roy Lenferink
b43c04452f Updated OWNERS files to include link to docs 2019-02-04 22:33:12 +01:00
globervinodhn
a2078bd4af Promote empty-key ConfigMap e2e to Conformance 2019-01-29 15:41:27 +05:30
Justin SB
19a5528a65
Remove executable permission from testdata 2019-01-03 12:21:31 -05:00
Aaron Crickenberger
ec2ba35662 Add new reviewers for conformance
Put into OWNERS files what has effectively been happening
for the past few months, we review and shepherd PR's
through other SIG reviewers before bringing to sig-arch
for a final /approve.

The goal is to eventually grow approvers when it's been
demonstrated that we have sufficient context.
2018-11-02 21:47:32 -07:00
k8s-ci-robot
77fd16e0e7
Merge pull request #69266 from SataQiu/fix-20180930
Remove the redundant space
2018-11-02 08:38:37 -07:00
SataQiu
c9bc625428 Remove the redundant space 2018-11-02 15:45:11 +08:00
pontiyaraja
b81936320b Promote Replication Controller and Replica Set e2e tests to Conformance 2018-11-01 00:20:04 +05:30
Aaron Crickenberger
a188653334 Add myself as reviewer to test/conformance/OWNERS
I'd like to start fielding more reviews of this code since I'm actively
involved in efforts that are consumers of it
2018-10-29 15:48:00 -07:00
k8s-ci-robot
1ba56437d9
Merge pull request #69673 from dims/add-labels-when-conformance-directory-changes
Add labels when conformance/ directory changes
2018-10-13 07:37:32 -07:00
Davanum Srinivas
744b8c1694
Add labels when conformance/ directory changes
So we don't have to do this manually for every PR

Change-Id: I4dc656e84ff6c48bc582b2aee6615bef11553257
2018-10-11 07:18:07 -04:00
Michelle Au
17c0e9f7ea Update build and conformance test list 2018-10-09 14:27:58 -07:00
k8s-ci-robot
321313b19e
Merge pull request #69004 from mgdevstack/master-pods-websocket-conformance
Promote pod's websocket based NodeConformance tests to Conformance
2018-10-08 22:28:12 -07:00
k8s-ci-robot
a34123d9c3
Merge pull request #67901 from dims/drop-flaky-test-from-conformance
Remove conformance tag from flaky test
2018-10-08 19:24:58 -07:00
k8s-ci-robot
766d860f86
Merge pull request #69021 from mgdevstack/master-kubelet-conformance
Promote kubelet NodeConformance tests to Conformance
2018-10-04 18:19:25 -07:00
Mayank Gaikwad
78a15ed1c9 Promote pod's websocket based NodeConformance tests to Conformance 2018-09-30 21:57:49 +05:30
k8s-ci-robot
1e4edac012
Merge pull request #68886 from mgdevstack/master-emptydir-wrapper
Promote emptyDir wrapper volumes tests to Conformance
2018-09-26 20:37:47 -07:00
Mayank Gaikwad
696c9ea0b1 Promote kubelet NodeConformance tests to Conformance 2018-09-25 08:54:20 +05:30
Mayank Gaikwad
b9942796db Promote emptyDir wrapper volume tests to conformance 2018-09-24 15:39:20 +05:30
Mayank Gaikwad
8b0a5950ab Promote non-table based container runtime test to conformance 2018-09-20 18:59:59 +05:30
Davanum Srinivas
ab2d66fd75
Remove conformance tag from flaky test
We should not have potentially flaky tests in conformance test suite

Change-Id: I83588667f59a0a7c07db39fe596b7d952c1d543b
2018-08-30 09:10:37 -04:00
Kubernetes Submit Queue
99fab84c7a
Merge pull request #67100 from mkurylec/promotion-lifecycle-hook-to-conformance
Automatic merge from submit-queue (batch tested with PRs 67100, 67426). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

porting e2e_node lifecycle testcases into e2e folder under common

a) Shifted (and renamed) file existing in e2e_node to e2e/common.
b) Added these tests to the conformance suite:
- "should execute poststart exec hook properly"
-  "should execute prestop exec hook properly"
- "should execute poststart http hook properly"
- "should execute prestop http hook properly"

[reference issue](https://github.com/kubernetes/kubernetes/issues/67086) explaining the effort.
2018-08-16 11:57:28 -07:00
Kubernetes Submit Queue
f9d63000a3
Merge pull request #67071 from mgdevstack/master-secretvolume-nodeconformance
Automatic merge from submit-queue (batch tested with PRs 67071, 66906, 66722, 67276, 67039). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Promoting "[sig-storage] Secrets should be able to mount in a volume regardless of a different secret existing with same name in different namespace" to Conformance

**What this PR does / why we need it**:
An consolidated effort to resolve the issue https://github.com/kubernetes/kubernetes/issues/66875
> _[sig-storage] Secrets   should be able to mount in a volume regardless of a different secret existing with same name in different namespace_

Promoting mentioned e2e test for Conformance as it -
- Validates that secret with same name can be created in different namespaces but secrets which reside in same namespace as that of pod can be only be accessed from volume mounted in the container.
- Improves api coverage including prioritized Pod API lists. https://github.com/cncf/k8s-conformance/issues/220#issuecomment-393344061

> GET /api/v1/namespaces/{namespace}/pods/{name}/log
GET /api/v1/namespaces/{namespace}/pods
GET /api/v1/namespaces/{namespace}/pods/{name}
POST /api/v1/namespaces/{namespace}/pods
PUT /api/v1/namespaces/{namespace}/pods/{name}/status
DELETE /api/v1/namespaces/{namespace}/pods
DELETE /api/v1/namespaces/{namespace}/pods/{name}

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
No Flakes Found.
```
• [SLOW TEST:16.326 seconds]
[sig-storage] Secrets
/home/vagrant/go-workspace/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/secrets_volume.go:33
  should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance]
  /home/vagrant/go-workspace/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/common/secrets_volume.go:86
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
Aug  7 07:12:44.133: INFO: Running AfterSuite actions on all node
Aug  7 07:12:44.134: INFO: Running AfterSuite actions on node 1

Ran 1 of 1020 Specs in 16.441 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 1019 Skipped PASS

All tests passed...
Will keep running them until they fail.
This was attempt #40
No, seriously... you can probably stop now.
```

**Release note**:

```release-note
NONE
```
/area conformance
@kubernetes/sig-node-pr-reviews
2018-08-14 22:43:15 -07:00
Kubernetes Submit Queue
6cc7b1cd3a
Merge pull request #66969 from mgdevstack/master-configmap-bindata-nodeconformance
Automatic merge from submit-queue (batch tested with PRs 61212, 66369, 66446, 66895, 66969). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Promoting configmap binarydata support [NodeConformance] test to conformance

**What this PR does / why we need it**:

**e2e:** _[sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance]_
Promotes mentioned e2e to conformance as it -
1. Validates ConfigMap's binarydata support effectively
2. Improves API Coverage for prioritized api lists. (https://github.com/cncf/k8s-conformance/issues/220#issuecomment-393344061)

> GET /api/v1/namespaces/{namespace}/pods
GET /api/v1/namespaces/{namespace}/pods/{name}
GET /api/v1/namespaces/{namespace}/pods/{name}/log
POST /api/v1/namespaces/{namespace}/pods
PUT /api/v1/namespaces/{namespace}/pods/{name}/status
DELETE /api/v1/namespaces/{namespace}/pods
DELETE /api/v1/namespaces/{namespace}/pods/{name}

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
No Flakes found.

**Release note**:

```release-note
NONE
```
/area conformance
@kubernetes/sig-node-pr-reviews
2018-08-14 21:18:19 -07:00