Commit Graph

465 Commits

Author SHA1 Message Date
Jordan Liggitt
e7b0ec5857 Replicate update/patch operations from eviction test in conformance CRUD test 2021-03-15 16:54:45 -04:00
Kubernetes Prow Robot
cd66a33b32
Merge pull request #100092 from liggitt/conformance-pdb
[test-only] Promote PDB CRUD e2e tests to conformance
2021-03-10 22:42:35 -08:00
Kubernetes Prow Robot
be419673a2
Merge pull request #98677 from zachmandeville/ineligible_endpoint
add ineligible_endpoints.yaml
2021-03-10 08:15:14 -08:00
Jordan Liggitt
be58ad6fec Promote PDB CRUD e2e tests to conformance 2021-03-10 11:02:47 -05:00
Kubernetes Prow Robot
956de2644f
Merge pull request #100036 from dims/revert-andrewsykim-conformance-probe-tests
Revert : conformance: promote container exec probe timeout tests
2021-03-09 20:37:13 -08:00
Davanum Srinivas
ecc8de7083
Revert : conformance: promote container exec probe timeout tests
Reverting af3e118b1f and
2242d0ffc4 as these tests fail when
ExecProbeTimeout feature gate is turned on.

Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2021-03-09 17:05:07 -05:00
Morten Torkildsen
08e0a46757 Promote PodDisruptionBudget e2e test to Conformance 2021-03-09 12:26:02 -08:00
Kubernetes Prow Robot
16e9c682ff
Merge pull request #99495 from wojtek-t/cleanup_describe_8
Move ownership of core events test to sig-instrumentation
2021-03-09 04:27:38 -08:00
Kubernetes Prow Robot
faa3a5fbd4
Merge pull request #99916 from swetharepakula/eps-ga-e2e
Promote Endpoint Slice E2E Tests to Conformance
2021-03-08 20:47:45 -08:00
Kubernetes Prow Robot
761cdf33a2
Merge pull request #99952 from ii/Promote-ReplicaSet-Test
Promote ReplicaSet Replace and Patch Test +2 Endpoints
2021-03-08 19:24:18 -08:00
Kubernetes Prow Robot
b85313b6dd
Merge pull request #99853 from wojtek-t/cleanup_describe_17
Cleanup the remaining multi-owned sig-node tests
2021-03-08 19:23:44 -08:00
Riaan Kleinhans
c3fb2c002a Promote ReplicaSet e2e test to Conformance 2021-03-09 09:54:04 +13:00
Swetha Repakula
17beeaf47a Promote EndpointSlice E2E Tests to Conformance 2021-03-08 09:44:47 -08:00
Maciej Szulik
3c9bbe427b
Promote cronjob e2es to conformance 2021-03-06 19:01:02 +01:00
wojtekt
ae8baefeff Cleanup the remaining multi-owned sig-node tests 2021-03-05 20:27:31 +01:00
wojtekt
3a8e84c2da Move ownership of core events test to sig-instrumentation 2021-03-05 16:47:16 +01:00
Kubernetes Prow Robot
5bf49baf71
Merge pull request #99558 from BenTheElder/gen-conformance-md
add test/conformance/gen-conformance-docs.sh
2021-03-04 06:42:21 -08:00
wojtekt
d4883f532e Remove KubeDescribe 2021-03-04 07:54:53 +01:00
wojtekt
3b438eb4e5 Cleanup test/e2e/common directory - part2 2021-03-03 10:27:35 +01:00
wojtekt
f4407f4db8 Assign remaining test/e2e/common test to SIGs 2021-03-02 21:34:58 +01:00
Benjamin Elder
56e092e382 hack/update-bazel.sh 2021-02-28 15:17:29 -08:00
Benjamin Elder
5eedf2a0f1 nit: newlines 2021-02-28 13:04:21 -08:00
Benjamin Elder
5ed5a5fe25 add test/conformance/gen-conformance-docs.sh 2021-02-28 13:01:07 -08:00
Kubernetes Prow Robot
a185bafa0c
Merge pull request #99549 from BenTheElder/conformance-make
conformance.yaml: generate with make
2021-02-28 05:30:39 -08:00
Benjamin Elder
025e6de3eb don't run generated_files when generating specsummaries.json 2021-02-28 00:54:54 -08:00
Benjamin Elder
ed09168e8a fix generated conformance filepaths when test binary is not stripped 2021-02-28 00:54:54 -08:00
Benjamin Elder
c1c3fdefe3 port conformance yaml generation to hack 2021-02-28 00:54:54 -08:00
wojtekt
cad9957f95 Remove KubeDescribe from SIGDescribe calls 2021-02-26 08:49:25 +01:00
Kubernetes Prow Robot
ca916183db
Merge pull request #99460 from wojtek-t/transfer_secrets_ownership
Align ownership of secret and configmap tests to sig-node
2021-02-25 13:52:56 -08:00
Kubernetes Prow Robot
5feb39fdb3
Merge pull request #99458 from wojtek-t/cleanup_describe_1
Replace some nested KubeDescribe calls with ginkgo.Describe
2021-02-25 08:01:25 -08:00
wojtekt
8df355b80a Replace some nested KubeDescribe calls with ginkgo.Describe 2021-02-25 14:44:39 +01:00
wojtekt
22429ab642 Align ownership of secret and configmap tests to sig-node 2021-02-25 14:38:02 +01:00
wojtekt
7b2458ac01 Cleanup tests/e2e/common directory - part 1 2021-02-24 20:44:14 +01:00
Kubernetes Prow Robot
9a8da9ee43
Merge pull request #97619 from andrewsykim/conformance-probe-tests
conformance: promote container exec probe timeout tests
2021-02-23 22:56:49 -08:00
Kubernetes Prow Robot
1db189eab2
Merge pull request #99316 from zshihang/conformance
promote RootCAConfigMap e2e test to Conformance
2021-02-23 15:23:46 -08:00
Kubernetes Prow Robot
462dbc17aa
Merge pull request #99282 from ii/Promote-ReplicaSetScale-Test
Promote Read, Replace and Patch ReplicaSetScale test to Conformance +3 endpoints
2021-02-23 15:23:19 -08:00
Kubernetes Prow Robot
f499d27535
Merge pull request #99281 from ii/Promote-DeploymentScale-Test
Promote Read, Replace and Patch DeploymentScale test to Conformance +3 endpoints
2021-02-23 15:23:12 -08:00
Shihang Zhang
5d1774e9db promote RootCAConfigMap e2e test to Conformance 2021-02-22 10:37:41 -08:00
Riaan Kleinhans
8faa3307ec Promote ReplicaSetScale e2e test to Conformance 2021-02-22 04:03:17 +13:00
Mayank Kumar
2dfc7c3943 Promote RunAsGroup e2e test to Conformance 2021-02-18 21:21:29 -08:00
Riaan Kleinhans
303fd4aca2 Promote DeploymentScale e2e test to Conformance 2021-02-19 13:13:29 +13:00
wojtekt
498441448c Minor refactor of test/e2e/common names 2021-02-15 08:16:01 +01:00
Kubernetes Prow Robot
528390348d
Merge pull request #98126 from ii/statefulset_test
Update: StatefulSet Replica scaling to include Patch Scale +1 endpoint
2021-02-12 09:27:09 -08:00
Riaan Kleinhans
866f658695 Update e2e patch scale statefulset test
Test now validates patchAppsV1NamespacedStatefulSetScale endpoint.
Update conformance metadata to include v1.21

Co-authored-by: Stephen Heywood <stephen@ii.coop>
2021-02-12 09:43:48 +13:00
Kubernetes Prow Robot
2ebd3b99ac
Merge pull request #98940 from ii/remove-conformance-metadata
Update conformance metadata for relocated test
2021-02-11 11:02:15 -08:00
Kubernetes Prow Robot
ab15313f1e
Merge pull request #98586 from mtaufen/said-conform
Promote ServiceAccountIssuerDiscovery test to conformance
2021-02-11 02:40:15 -08:00
Stephen Heywood
ee7ee85669 Update conformance metadata for relocated test 2021-02-10 13:32:58 +13:00
Stephen Heywood
c88a838282 Promote pod and service ProxyWithPath e2e test to Conformance 2021-02-09 11:50:22 +13:00
Michael Taufen
f3e223cbbc Promote ServiceAccountIssuerDiscovery test to conformance
This satisfies the graduation criteria for promoting
ServiceAccountIssuerDiscovery to GA, per the KEP:
https://github.com/kubernetes/enhancements/tree/master/keps/sig-auth/1393-oidc-discovery

The test only uses GA APIs and has been passing for well
over two weeks:
https://testgrid.k8s.io/sig-release-master-blocking#gce-cos-master-alpha-features&include-filter-by-regex=ServiceAccountIssuerDiscovery
2021-02-05 16:05:15 -08:00
Zach Mandeville
0f597e23aa add ineligible_endpoints.yaml
This yaml contains GA endpoints currently ineligible for conformance,
along with the reason for their ineligibility and a link with
context to that reason.  It's intention is to give a transparent and
community-supported way to track these endpoints.
2021-02-02 11:25:47 +13:00
Antonio Ojea
08a8e80c9f move e2e hostport conflict test to sig-network
The test "validates that there is no conflict between pods with same
hostPort but different hostIP and protocol" was testing the scheduler
capability to schedule pods on the same node with hostPorts, however,
it wasn´t validating that the HostPorts was working, causing false
positives, because the pods were scheduled, but the HostPort exposed
wasn´t working.

In order to test the HostPort functionality, we have to use HostNetwork
pods, that are incompatible with Windows platforms. Also, since this
is touching both network and scheduling, there is no clear the ownership,
but sig-network is happy to adopt it.

We also add a new test for scheduling only under "scheduling", so Windows
folks can use it to test the scheduled in that platform.
2021-01-27 21:55:36 +01:00
Kubernetes Prow Robot
33ee864e92
Merge pull request #97003 from ravisantoshgudimetla/remove-scheduler-preemption-test-from-conformance
make hostPort match test linuxonly
2021-01-14 19:39:51 -08:00
ravisantoshgudimetla
32c2ec5ceb conformance changes 2021-01-14 16:40:39 -05:00
Kubernetes Prow Robot
c5cc25d1cb
Merge pull request #97615 from wojtek-t/immutable_secrets_ga
Promote Immutable Secrets/ConfigMaps to Stable
2021-01-07 00:03:45 -08:00
Andrew Sy Kim
2242d0ffc4 test/conformance: generate testdata for adding probe exec timeout tests
Signed-off-by: Andrew Sy Kim <kim.andrewsy@gmail.com>
2021-01-04 10:39:01 -05:00
wojtekt
60828f36f8 Update conformance tests list 2020-12-30 16:56:08 +01:00
Riaan Kleinhans
de9dd82c54 Extend APIService e2e testing of endpoints
e2e test validates the following 3 extra endpoints
- readApiregistrationV1APIServiceStatus
- patchApiregistrationV1APIService
- listApiregistrationV1APIService
2020-12-18 09:25:13 +13:00
Kubernetes Prow Robot
8b2f5be319
Merge pull request #96485 from ii/promote-lifecycle-test-pod-podstatus
Promote Pod+PodStatus resource lifecycle test - +4 endpoint coverage
2020-11-23 11:39:01 -08:00
Kubernetes Prow Robot
1ea29cec9c
Merge pull request #96487 from ii/promote-lifecycle-test-deployment
Promote AppsV1Deployment resource lifecycle test - +6 endpoint coverage
2020-11-19 13:02:51 -08:00
Kubernetes Prow Robot
1df1f882c4
Merge pull request #96619 from SergeyKanzhelev/runtimeAPIConf
convert the runtimeclass API tests to conformance
2020-11-18 08:40:05 -08:00
Sergey Kanzhelev
5da4cf0478 convert the runtimeclass API tests to conformance 2020-11-16 21:56:57 +00:00
Stephen Heywood
e6f7fed324 Promote Deployment lifecycle e2e test to Conformance 2020-11-12 13:19:05 +13:00
Stephen Heywood
16480d8ec0 Promote Pod/PodStatus lifecycle e2e test to Conformance 2020-11-12 12:21:40 +13:00
Shihang Zhang
22ae49bb5d Promote TokenRequest e2e test to Conformance 2020-11-06 13:51:48 -08:00
Carlos Panato
a9ff313c5b
use patch instead of replace to test the dry-run option 2020-11-03 14:27:16 +01:00
Jefftree
4d979f6f12 Remove behaviors 2020-10-29 12:05:54 -07:00
Stephen Heywood
017de540eb Promote verify PriorityClass endpoints e2e test to Conformance 2020-10-27 12:36:28 +13:00
Stephen Heywood
995583938a Promote Replication Controller lifecycle e2e test to Conformance 2020-10-20 12:24:52 +13:00
Stephen Heywood
d1caabdabd Switch events conformance metadata from v1.19 to v1.20 2020-10-16 11:06:22 +13:00
Kubernetes Prow Robot
7a5b058f27
Merge pull request #95016 from Jefftree/remove-kubeconform
Remove kubeconform
2020-10-06 16:54:42 -07:00
Kubernetes Prow Robot
5e44d8ebaf
Merge pull request #95015 from Jefftree/bdd-remove-dependency
Remove dependency on behaviors for conformance walk.go
2020-10-05 13:04:19 -07:00
Ricardo Pchevuzinske Katz
ab129349ac Change kubectl clusterinfo to non offensive words
Signed-off-by: Ricardo Pchevuzinske Katz <ricardo.katz@gmail.com>
2020-10-01 08:25:52 -03:00
Jefftree
6b8c8e44d8 Update bazel 2020-09-23 14:27:49 -07:00
Jefftree
88b22516ea Remove kubeconform 2020-09-23 13:33:37 -07:00
Jefftree
fe972b8f2f Remove dependency on behaviors for conformance generation 2020-09-23 13:28:06 -07:00
Mike Danese
d182ecc1f9 output go_binary rule directly from go_binary_conditional_pure
And same for go_test_conditional_pure.

Instead of aliasing. Aliases are annoying in a number of ways. This is
specifically bugging me now because they make the action graph harder to
analyze programmatically. By using aliases here, we would need to handle
potentially aliased go_binary targets and dereference to the effective
target.

The comment references an issue with `pure = select(...)` which appears
to be resolved considering this now builds.
2020-09-11 13:19:37 -07:00
Kubernetes Prow Robot
fa1a3e0f74
Merge pull request #93665 from dims/emeritus-bgrant0607
Move bgrant0607 to emeritus status.
2020-08-14 00:48:22 -07:00
Davanum Srinivas
fbca4e3ee9
Move bgrant0607 to emeritus status.
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-08-03 21:50:46 -04:00
Kubernetes Prow Robot
0d2299e227
Merge pull request #93271 from ii/promote-preferred-version
Promote: Discovery PreferredVersion test+16 Endpoints
2020-08-03 18:46:19 -07:00
Jefftree
ace97738e2 Update formatting of conformance comment 2020-07-29 20:50:44 -07:00
Kubernetes Prow Robot
f105cfc210
Merge pull request #93487 from ii/fix-missing-e2e-test-metadata
Add missing release metadata for e2e tests
2020-07-28 19:26:10 -07:00
Kubernetes Prow Robot
5ca6d567c4
Merge pull request #93086 from ii/heyste-create-delete-core-v1-collection-namespaced-pod-test
Promote Delete Collection Pods e2e test to conformance +1 endpoint coverage
2020-07-28 19:25:48 -07:00
Stephen Heywood
1077a9e862 Add missing release metadata for e2e tests 2020-07-27 21:56:49 +00:00
Caleb Woodbine
e311df70e1 Promote Endpoint resource lifecycle test 2020-07-27 09:11:42 +12:00
Chelsey Chen
5b1bdd8e38 Add comformance test for event Update 2020-07-21 14:53:26 -04:00
Stephen Heywood
86ba88d52f Promote: Discovery PreferredVersion test 2020-07-21 00:30:25 +00:00
Kubernetes Prow Robot
c237804533
Merge pull request #92755 from chelseychen/event-e2e-conformance
Promote Event CRUD tests to conformance
2020-07-20 05:50:51 -07:00
Kubernetes Prow Robot
3a0b683c01
Merge pull request #93084 from ii/heyste-get-code-version-test
Promote Check Server Version e2e test to conformance - 1 Endpoint Coverage
2020-07-18 06:14:50 -07:00
Kubernetes Prow Robot
1f4da99f69
Merge pull request #92813 from ii/heyste-create-delete-core-v1-collection-namespaced-event-test
Promote deleteCoreV1CollectionNamespacedEvent test - +1 endpoint coverage
2020-07-15 19:16:34 -07:00
Kubernetes Prow Robot
8c300565c2
Merge pull request #90941 from ii/ii-promote-configmap-lifecycle
Promote: ConfigMap Lifecycle test - +2 conformance endpoint coverage
2020-07-15 15:28:48 -07:00
Stephen Heywood
44cd9d3cfe Promote delete collection pods e2e test to conformance 2020-07-14 02:56:54 +00:00
Stephen Heywood
236ad47783 Promote server version e2e test to conformance 2020-07-14 02:22:07 +00:00
Chelsey Chen
7e04ffbc31 Promote Event CRUD tests to conformance 2020-07-13 09:50:23 -04:00
Kubernetes Prow Robot
cccb28bb5e
Merge pull request #92812 from ii/heyste-create-delete-core-v1-collection-namespaced-pod-template-test
Promote DeleteCoreV1CollectionNamespacedPodTemplate test+promote - +1 endpoint
2020-07-10 15:43:01 -07:00
Kubernetes Prow Robot
d9b084a9d1
Merge pull request #89629 from fatedier/subpath
Modified subpath configmap mount fails when container restarts
2020-07-09 09:06:32 -07:00
Stephen Heywood
e76ac2dc2b Promote: event delete a collection test 2020-07-05 23:27:17 +00:00
fatedier
78b5003e88 update e2e test 2020-07-03 20:31:00 +08:00
Stephen Heywood
0da98ad96f Promote: PodTemplate delete a collection test 2020-07-03 00:02:58 +00:00
Caleb Woodbine
82c99d8d42 Fix metadata release version 2020-06-24 09:30:50 +12:00
Caleb Woodbine
b20856e5bb Add conformance testdata 2020-06-24 09:30:50 +12:00
Kubernetes Prow Robot
9cd906e932
Merge pull request #91996 from cmluciano/cml/promotedingv1crud
ingress: promote CRUD API tests for v1 to conformance
2020-06-22 09:24:40 -07:00
Kubernetes Prow Robot
0a91893126
Merge pull request #92119 from BenTheElder/agnhost-sync
agnhost sync
2020-06-20 00:14:39 -07:00
Benjamin Elder
279ce5d89e s/master/primary in agnhost guestbook test references & agnhost code
to do in follow-up: update the agnhost deployments and references to those when the new image is pushed
2020-06-19 12:23:16 -07:00
Kubernetes Prow Robot
dcb587e09f
Merge pull request #91230 from ii/heyste-create-delete-core-v1-collection-namespaced-event-test
Create deleteCoreV1CollectionNamespacedEvent test+promote - +1 endpoint coverage
2020-06-18 08:12:20 -07:00
Christopher M. Luciano
ca2b5b7605
ingress: promote CRUD API tests for v1 to conformance
Signed-off-by: Christopher M. Luciano <cmluciano@us.ibm.com>
2020-06-17 13:01:16 -04:00
Benjamin Elder
d65a3b15bf update agnhost guestbook usage for s/slave/replica/ 2020-06-15 20:08:27 -07:00
Kubernetes Prow Robot
2e6eff75e5
Merge pull request #92002 from liggitt/csr-client-conformance
Move kube-apiserver client cert back to simple e2e
2020-06-12 02:23:57 -07:00
Kubernetes Prow Robot
111741071f
Merge pull request #91743 from spiffxp/fix-kubeconform-link
Merge behavior loading code
2020-06-10 17:13:10 -07:00
Jordan Liggitt
6fb7d40a72 Move kube-apiserver client cert back to simple e2e 2020-06-10 15:28:26 -04:00
Stephen Heywood
04627cef49 Address issues with test failures 2020-06-08 20:41:32 +12:00
Jordan Liggitt
ea8f4cb536 Update CSR e2e to use v1 2020-06-05 00:50:01 -04:00
Aaron Crickenberger
d960bf1903 behaviors: enforce behavior id must have suite id as prefix 2020-06-03 16:59:34 -07:00
Aaron Crickenberger
85724cf2c3 behaviors: fix kubeconform link
kubeconform was choking on a typo in the description field, so I fixed
the typo while adding friendlier logging to tell me which file was
invalid

I got curious why tests didn't catch this, and it turns out kubeconform
and the behavior tests use different codepaths to load and validate. So
I merged them together
2020-06-03 16:59:27 -07:00
Kubernetes Prow Robot
bb11561ace
Merge pull request #80545 from spiffxp/promote-preemption-tests
Promote SchedulerPreemption e2e tests to Conformance
2020-06-02 15:28:16 -07:00
Kubernetes Prow Robot
65c0a1e64b
Merge pull request #89716 from Jefftree/bdd-initial-link
Add behavior <-> conformance test linkage example for pods
2020-05-26 23:24:41 -07:00
Aaron Crickenberger
4857893a0c Promote preemption e2e tests to Conformance 2020-05-20 23:05:15 -07:00
Kubernetes Prow Robot
57b0c310b7
Merge pull request #90390 from ii/promote-serviceaccount-resource-lifecycle-test
Promote ServiceAccount resource lifecycle test - +3 conformance coverage
2020-05-20 16:44:33 -07:00
Kubernetes Prow Robot
62a4cb930b
Merge pull request #90367 from julianvmodesto/conformance-diff-dry-run
Promote diff and dry-run to conformance
2020-05-20 16:44:19 -07:00
Jefftree
c7216b9a1b Fix unmarshal for tests without behaviors 2020-05-18 23:35:25 -07:00
Jefftree
ceb67482c4 link 2 pod conformance tests with behaviors 2020-05-18 23:35:25 -07:00
Julian V. Modesto
7af0011884 Promote diff and dry-run to conformance 2020-05-13 13:04:41 -04:00
Davanum Srinivas
b64e904ca8
Drop conformance for a HostPath test
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-05-07 22:40:00 -04:00
Davanum Srinivas
3292bb6145
Drop conformance tag for tests that rely directly on kubelet /logs API
In caf0d1d61874a2c8687b7deb773eca30ddaee5b6 we documented a policy to
ensure that conformance tests should not rely in existence or use of
kubelet apis directly. So based on that we should drop conformance for
the two tests here that use the "/logs" endpoint directly.

Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-04-29 20:16:51 -04:00
Kubernetes Prow Robot
c12aeb2b77
Merge pull request #89753 from ii/promote-event-resource-lifecycle-test
Promote Event resource lifecycle test  +5 test endpoint coverage
2020-04-23 03:57:45 -07:00
Caleb Woodbine
e09e781a0c Promote ServiceAccount resource lifecycle test 2020-04-23 16:32:54 +12:00
Kubernetes Prow Robot
b7a6d53f5e
Merge pull request #88924 from dims/add-support-for-listing-conformance-tests-in-e2e.test
Add support for listing conformance tests in e2e.test
2020-04-15 13:14:45 -07:00
Kubernetes Prow Robot
53ffaa7175
Merge pull request #76443 from mgdevstack/promote-service-sessionaffinity
Promote e2e "verifying service's sessionAffinity for ClusterIP and NodePort services" to Conformance
2020-04-07 18:47:44 -07:00
Kubernetes Prow Robot
3072d1e22e
Merge pull request #88036 from ii/promote-podtemplate-lifecycle
Promote: PodTemplate Lifecycle test - +3 conformance endpoint coverage
2020-04-07 15:27:43 -07:00
Kubernetes Prow Robot
f21bd9efb9
Merge pull request #89745 from johnbelamaric/kubeconform-cleanup
Various cleanup for the kubeconform command
2020-04-07 12:49:44 -07:00
Kubernetes Prow Robot
667e028f38
Merge pull request #83378 from ii/promote-pod-replicaset-verification
Promote pod PreemptionExecutionPath verification - +3 conformance endpoint coverage
2020-04-06 19:09:43 -07:00
Mayank Gaikwad
7aa94a6549 Promote e2e verifying service's session affinity behaviours 2020-04-06 21:42:22 +05:30
Caleb Woodbine
31fea24c39 Promote Event resource lifecycle test 2020-04-02 15:36:49 +13:00
John Belamaric
de5d8d612b Various cleanup for the kubeconform command 2020-04-01 14:39:52 -07:00
Davanum Srinivas
d1c948acdc
Add support for listing conformance tests
we print yaml, so you can use yaml tools like `yq`:
```
e2e.test --list-conformance-tests | yq r - --collect *.testname
```

Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-04-01 10:48:53 -04:00
Caleb Woodbine
ce97b49965 Update conformance metadata 2020-04-01 12:54:09 +13:00
Aaron Crickenberger
ec0d6cb693 Fix bazel location of testdata 2020-03-31 16:11:18 -07:00
Caleb Woodbine
63632118b7 Fix conformance testdata 2020-04-01 09:43:56 +13:00
Caleb Woodbine
02f983d8c8 Update metadata 2020-03-27 08:59:33 +13:00
Jefftree
074a676dbc kubetestgen -> kubeconform 2020-03-25 14:37:09 -07:00
Jefftree
77edd42619 Add CLI script for listing untested conformance behaviors 2020-03-25 14:37:09 -07:00
Kubernetes Prow Robot
1da4f75e24
Merge pull request #85128 from kevtaylor/kep/VolumeSubpathExpansion-Conformance
Promote VolumeSubpathEnvExpansion e2e tests to Conformance
2020-03-23 15:32:47 -07:00
Jefftree
40d80195f2 Only check testname for missing 2020-03-18 14:54:06 -07:00
Jefftree
90cd496e72 Include testname 2020-03-18 14:54:06 -07:00
Kevin Taylor
468b3b40d8 Promote VolumeSubpathExpansion e2e tests to Conformance 2020-03-12 20:05:28 +00:00
Jefftree
db714336a9 Update conformance.yaml to remove comments not part of Description 2020-03-06 11:37:35 -08:00
Jefftree
6da6380d1b Capture behaviors in walk.go 2020-03-06 11:09:25 -08:00
fengzixu
076132e38a cleanup: move the test of TaintBasedEvictions features to sig-node
1. move the integration test of TaintBasedEvictions to test/integration/node
2. move the e2e test of TaintBasedEvictions e2e test/e2e/node
3. modify the conformance file to adapt the TaintBasedEviction test
2020-03-04 10:28:00 +09:00
Caleb Woodbine
51d3f64b81 Fix conformance testdata 2020-03-02 14:23:29 +13:00
Caleb Woodbine
c33e3bdc28 Fix conformance testdata 2020-03-02 14:17:24 +13:00
Caleb Woodbine
67fb7c5989 Fix release number 2020-03-02 14:09:20 +13:00
Caleb Woodbine
40dadaaa9c Promote Pod Preemption Verification 2020-03-02 14:08:30 +13:00
Caleb Woodbine
633a72ce28 Promote: PodTemplate Lifecycle test 2020-03-02 13:57:17 +13:00
John Schnake
2683b1065c Update the conformance list and doc generation logic
The existing walk.go and conformance.txt have a few shortcomings
which we'd like to resolve:
 - difficult to get the full test name due to test context nesting
 - complicated AST logic and understanding necessary due to the
different ways a test can be invoked and written

This changes the AST parsing logic to be much more simple and simply
looks for the comments at/around a specific line. This file/line
information (and the full test name) is gathered by a custom ginkgo
reporter which dumps the SpecSummary data to a file.

Also, the SpecSummary dump can, itself, be potentially useful for
other post-processing and debugging tasks.

Signed-off-by: John Schnake <jschnake@vmware.com>
2020-02-24 14:00:44 -08:00
Kubernetes Prow Robot
23045f9247
Merge pull request #88057 from julianvmodesto/remove-deprecated-rolling-update
Remove deprecated rolling-update command
2020-02-21 18:31:30 -08:00
Kubernetes Prow Robot
5ab1f3464c
Merge pull request #88126 from johnbelamaric/behaviors-readme
Add a README describing behaviors
2020-02-18 14:04:41 -08:00
John Belamaric
ca399e6315 Add a README describing behaviors 2020-02-18 09:23:46 -08:00
Julian V. Modesto
932500c015 Remove deprecated rolling-update command 2020-02-13 23:52:53 -05:00
Jefftree
da4b0b0fa1 Validation for behaviors 2020-02-04 10:45:53 -08:00
Kubernetes Prow Robot
2a17cfbd45
Merge pull request #85960 from johnbelamaric/podspec-behaviors
Initial behavior examples for conformance
2020-02-02 14:47:21 -08:00
John Belamaric
becdd79067 Initial example behaviors
Organizes the behaviors directory based on SIG, and provides a few
example behavior descriptions for Pods and Services to start. Note
that these are very incomplete lists of behaviors at this point.
2020-01-31 11:25:55 -08:00
Kubernetes Prow Robot
dba8d60f8c
Merge pull request #87077 from soltysh/remove_run_generators
Remove kubectl run generators
2020-01-29 12:16:14 -08:00
Kubernetes Prow Robot
7883d93877
Merge pull request #87262 from ii/promote-secret-patching-test
Promote: Secret patching test
2020-01-29 07:32:28 -08:00
Kubernetes Prow Robot
1590c7b31c
Merge pull request #87371 from ii/promote-limit-range-defaults-test
Add: promotion for LimitRange defaults test to Conformance
2020-01-28 20:46:14 -08:00
Kubernetes Prow Robot
426b353890
Merge pull request #87260 from ii/promote-test-for-kubernetes-service-in-default-namespace
Promote: find Kubernetes Service in default Namespace
2020-01-25 03:05:01 -08:00
Kubernetes Prow Robot
4a3cbfea89
Merge pull request #87256 from ii/promote-namespace-patch-test
Promote: Namespace patch test
2020-01-23 17:40:45 -08:00
Maciej Szulik
82f97775b7
Remove kubectl run generators 2020-01-22 16:44:00 +01:00
Kubernetes Prow Robot
3091ae7aac
Merge pull request #85486 from spiffxp/conformance-liveness-tcp-probe
Promote a TCP socket probe test to Conformance
2020-01-21 16:26:35 -08:00
Caleb Woodbine
bc2aabaaeb Add: promotion for LimitRange defaults test to Conformance 2020-01-19 20:44:42 +00:00
Caleb Woodbine
8676fb3cdb Promote: Secret patching test 2020-01-15 20:37:23 +00:00
Caleb Woodbine
4efcb21af8 Promote: find Kuberntes Service in default Namespace 2020-01-15 20:16:02 +00:00
Caleb Woodbine
0f528a27ad Promote: Namespace patch test 2020-01-15 19:42:16 +00:00
Kubernetes Prow Robot
91e55c7927
Merge pull request #85154 from johnbelamaric/johnbelamaric-conformance-owners
Add johnbelamaric as conformance code reviewer/approver
2020-01-09 11:32:47 -08:00
Aaron Crickenberger
4d731d92bf Demote Delete Grace Period test to [Flaky]
This is currently the top flake against PRs, so I'm tagging it
as [Flaky]. Flaky tests can't be conformance tests, so I'm
removing it from [Conformance] as well until this is resolved.
2020-01-08 10:12:47 -08:00
Slava Semushin
02885845ff
kubetestgen: improve errors handling
- don't proceed when a file creation has been failed
- handle a possible error from WriteString()
2020-01-06 15:21:54 +00:00
Aaron Crickenberger
877381550d Revert "promote e2e tests for taint-tolerations in predicates"
This reverts commit 4d3d364d2b.

This commit promoted a test to conformance and also changed the test at
the same time. It should have been split up into two PRs to verify
whether the change had the intended effect. The test is now failing
consistently, so reverting.
2019-12-18 10:01:00 -05:00
Kubernetes Prow Robot
7fdefe5002
Merge pull request #84735 from liggitt/wardle-example-e2e
wardle example e2e
2019-12-17 12:00:28 -08:00
Jordan Liggitt
8111bb3d77 Update wardle e2e image 2019-12-16 11:06:11 -05:00
Jefftree
4d3d364d2b promote e2e tests for taint-tolerations in predicates 2019-12-05 16:54:02 -08:00
Aaron Crickenberger
3cbc07bb64 Promote a TCP probe test to Conformance 2019-11-21 12:12:58 -08:00
Dr. Stefan Schimanski
69282dc4d8 e2e: promote CRD defaulting test to conformance test 2019-11-15 15:19:45 +01:00
John Belamaric
3d745c4ad4 Add johnbelamaric as conformance code reviewer/approver 2019-11-12 13:51:16 -08:00
Jefftree
fd7eaffd99 kubetestgen implementation 2019-11-08 15:40:22 -08:00
John Belamaric
c0e6a8704c Add conformance-behavior-approvers to OWNERS_ALIASES 2019-10-29 11:24:06 -07:00
Timothy St. Clair
97055841b1 Audit of test/* OWNERS files 2019-10-10 15:52:51 -05:00
Kubernetes Prow Robot
c449359119
Merge pull request #74977 from mgdevstack/master-conformance-pqdn
Promote DNS e2e verifying PQDN resolution for cluster
2019-09-26 14:39:36 -07:00
Kubernetes Prow Robot
c0ad143f64
Merge pull request #82632 from wojtek-t/node_lease_conformance
Promote lease API test to Conformance
2019-09-26 13:02:49 -07:00
John Schnake
d0ab1f06fb Allow disruptive conformance tests and marks 2
- Adjusts tooling to allow disrutpive tests to be marked conformance
 - Updates the corresponding tests
 - Marks 2 tests as disruptive
2019-09-24 14:17:37 -05:00
wojtekt
4ec66c842e Promote lease API test to Conformance 2019-09-12 19:58:04 +02:00
John Belamaric
84070403da Add johnbelamaric as conformance approver 2019-09-11 12:36:13 -07:00
Mayank Gaikwad
eb07002d41 Promote PQDN for services DNS e2e to Conformance 2019-09-06 02:14:46 +05:30
Haowei Cai
fd68c41e42 promote crd discovery e2e to conformance 2019-08-30 14:07:19 -07:00
Kubernetes Prow Robot
1e6686e6af
Merge pull request #81864 from jpbetz/crd-conformance
Promote CRD e2e tests to conformance
2019-08-29 19:55:59 -07:00
Joe Betz
68bafe4404 Promote admission webhook e2e tests to conformance 2019-08-29 13:50:14 -07:00
Joe Betz
c7919e64ff Promote CRD e2e tests to conformance 2019-08-29 11:50:24 -07:00
Kubernetes Prow Robot
56aded4db0
Merge pull request #81721 from mattjmcnaughton/mattjmcnaughton/close-open-files-in-conformance
Close leaking files in `conformance/walk.go`
2019-08-23 00:51:45 -07:00
mattjmcnaughton
f7128535bd
Close leaking files in conformance/walk.go
We want to ensure we close this file handler if it was opened
successfully.
2019-08-21 08:59:35 -04:00
Mayank Gaikwad
7c64fc9d98 Promote e2e verifying service type updates 2019-08-14 16:07:59 +05:30
Kubernetes Prow Robot
9d3d20114a
Merge pull request #78331 from mgdevstack/master-promote-resourcequota
Promote resourceQuota e2e verifying 'object count quota' and 'quota scope' to Conformance
2019-08-08 17:57:25 -07:00
Kubernetes Prow Robot
cc4301025d
Merge pull request #80655 from johnbelamaric/promote-nodeport-creation
Promote NodePort service creation e2e test to conformance
2019-08-06 23:56:50 -07:00
John Belamaric
60a51ce020 Promote NodePort service creation e2e test to conformance 2019-08-06 16:23:40 -07:00