Commit Graph

123 Commits

Author SHA1 Message Date
John Schnake
2683b1065c Update the conformance list and doc generation logic
The existing walk.go and conformance.txt have a few shortcomings
which we'd like to resolve:
 - difficult to get the full test name due to test context nesting
 - complicated AST logic and understanding necessary due to the
different ways a test can be invoked and written

This changes the AST parsing logic to be much more simple and simply
looks for the comments at/around a specific line. This file/line
information (and the full test name) is gathered by a custom ginkgo
reporter which dumps the SpecSummary data to a file.

Also, the SpecSummary dump can, itself, be potentially useful for
other post-processing and debugging tasks.

Signed-off-by: John Schnake <jschnake@vmware.com>
2020-02-24 14:00:44 -08:00
Julian V. Modesto
932500c015 Remove deprecated rolling-update command 2020-02-13 23:52:53 -05:00
Kubernetes Prow Robot
dba8d60f8c
Merge pull request #87077 from soltysh/remove_run_generators
Remove kubectl run generators
2020-01-29 12:16:14 -08:00
Kubernetes Prow Robot
7883d93877
Merge pull request #87262 from ii/promote-secret-patching-test
Promote: Secret patching test
2020-01-29 07:32:28 -08:00
Kubernetes Prow Robot
1590c7b31c
Merge pull request #87371 from ii/promote-limit-range-defaults-test
Add: promotion for LimitRange defaults test to Conformance
2020-01-28 20:46:14 -08:00
Kubernetes Prow Robot
426b353890
Merge pull request #87260 from ii/promote-test-for-kubernetes-service-in-default-namespace
Promote: find Kubernetes Service in default Namespace
2020-01-25 03:05:01 -08:00
Kubernetes Prow Robot
4a3cbfea89
Merge pull request #87256 from ii/promote-namespace-patch-test
Promote: Namespace patch test
2020-01-23 17:40:45 -08:00
Maciej Szulik
82f97775b7
Remove kubectl run generators 2020-01-22 16:44:00 +01:00
Kubernetes Prow Robot
3091ae7aac
Merge pull request #85486 from spiffxp/conformance-liveness-tcp-probe
Promote a TCP socket probe test to Conformance
2020-01-21 16:26:35 -08:00
Caleb Woodbine
bc2aabaaeb Add: promotion for LimitRange defaults test to Conformance 2020-01-19 20:44:42 +00:00
Caleb Woodbine
8676fb3cdb Promote: Secret patching test 2020-01-15 20:37:23 +00:00
Caleb Woodbine
4efcb21af8 Promote: find Kuberntes Service in default Namespace 2020-01-15 20:16:02 +00:00
Caleb Woodbine
0f528a27ad Promote: Namespace patch test 2020-01-15 19:42:16 +00:00
Aaron Crickenberger
4d731d92bf Demote Delete Grace Period test to [Flaky]
This is currently the top flake against PRs, so I'm tagging it
as [Flaky]. Flaky tests can't be conformance tests, so I'm
removing it from [Conformance] as well until this is resolved.
2020-01-08 10:12:47 -08:00
Aaron Crickenberger
877381550d Revert "promote e2e tests for taint-tolerations in predicates"
This reverts commit 4d3d364d2b.

This commit promoted a test to conformance and also changed the test at
the same time. It should have been split up into two PRs to verify
whether the change had the intended effect. The test is now failing
consistently, so reverting.
2019-12-18 10:01:00 -05:00
Kubernetes Prow Robot
7fdefe5002
Merge pull request #84735 from liggitt/wardle-example-e2e
wardle example e2e
2019-12-17 12:00:28 -08:00
Jordan Liggitt
8111bb3d77 Update wardle e2e image 2019-12-16 11:06:11 -05:00
Jefftree
4d3d364d2b promote e2e tests for taint-tolerations in predicates 2019-12-05 16:54:02 -08:00
Aaron Crickenberger
3cbc07bb64 Promote a TCP probe test to Conformance 2019-11-21 12:12:58 -08:00
Dr. Stefan Schimanski
69282dc4d8 e2e: promote CRD defaulting test to conformance test 2019-11-15 15:19:45 +01:00
John Belamaric
c0e6a8704c Add conformance-behavior-approvers to OWNERS_ALIASES 2019-10-29 11:24:06 -07:00
Kubernetes Prow Robot
c449359119
Merge pull request #74977 from mgdevstack/master-conformance-pqdn
Promote DNS e2e verifying PQDN resolution for cluster
2019-09-26 14:39:36 -07:00
Kubernetes Prow Robot
c0ad143f64
Merge pull request #82632 from wojtek-t/node_lease_conformance
Promote lease API test to Conformance
2019-09-26 13:02:49 -07:00
wojtekt
4ec66c842e Promote lease API test to Conformance 2019-09-12 19:58:04 +02:00
John Belamaric
84070403da Add johnbelamaric as conformance approver 2019-09-11 12:36:13 -07:00
Mayank Gaikwad
eb07002d41 Promote PQDN for services DNS e2e to Conformance 2019-09-06 02:14:46 +05:30
Haowei Cai
fd68c41e42 promote crd discovery e2e to conformance 2019-08-30 14:07:19 -07:00
Kubernetes Prow Robot
1e6686e6af
Merge pull request #81864 from jpbetz/crd-conformance
Promote CRD e2e tests to conformance
2019-08-29 19:55:59 -07:00
Joe Betz
68bafe4404 Promote admission webhook e2e tests to conformance 2019-08-29 13:50:14 -07:00
Joe Betz
c7919e64ff Promote CRD e2e tests to conformance 2019-08-29 11:50:24 -07:00
Mayank Gaikwad
7c64fc9d98 Promote e2e verifying service type updates 2019-08-14 16:07:59 +05:30
Kubernetes Prow Robot
9d3d20114a
Merge pull request #78331 from mgdevstack/master-promote-resourcequota
Promote resourceQuota e2e verifying 'object count quota' and 'quota scope' to Conformance
2019-08-08 17:57:25 -07:00
Kubernetes Prow Robot
cc4301025d
Merge pull request #80655 from johnbelamaric/promote-nodeport-creation
Promote NodePort service creation e2e test to conformance
2019-08-06 23:56:50 -07:00
John Belamaric
60a51ce020 Promote NodePort service creation e2e test to conformance 2019-08-06 16:23:40 -07:00
Aaron Crickenberger
e0750bd8db Promote taint-based eviction e2e tests to Conformance 2019-07-26 11:50:25 -07:00
Kubernetes Prow Robot
9e4b126e18
Merge pull request #80550 from spiffxp/promote-jobs-complete-after-restart
Promote job completion after failure e2e test to Conformance
2019-07-25 22:35:58 -07:00
Kubernetes Prow Robot
8497639221
Merge pull request #80544 from spiffxp/promote-jobs-adopt-release-orphan-pods
Promote job pod orphaning/adotion e2e test to Conformance
2019-07-25 20:48:36 -07:00
Kubernetes Prow Robot
2321d1e9e8
Merge pull request #80150 from ii/promote-statefulset-replica-scaling
Promote StatefulSet Replica scaling
2019-07-25 16:02:07 -07:00
Mayank Gaikwad
a921970745 Promote resourceQuota e2e verifying 'object count quota' and 'quota scope' to Conformance 2019-07-25 20:01:35 +05:30
Aaron Crickenberger
e0b9d77609 Promote job completion after failure e2e test to Conformance 2019-07-24 17:17:07 -07:00
Aaron Crickenberger
275b7b2fa0 Promote job pod orphaning/adotion e2e test to Conformance 2019-07-24 16:28:10 -07:00
Kubernetes Prow Robot
65b094676f
Merge pull request #78350 from globervinodhn/hostip_hostport_promote
Promote existing E2Es for hostport/HostIP resolution to conformance
2019-07-19 14:25:24 -07:00
Caleb Woodbine
5db35e67ee Fix placement of test in conformance.txt 2019-07-16 21:36:55 +00:00
Caleb Woodbine
91da6fd565 Promote API metadata return value 2019-07-15 21:40:14 +00:00
Caleb Woodbine
a062367251 Promote StatefulSet Replica scaling 2019-07-15 02:02:39 +00:00
pontiyaraja
40146c85f4 re-named conformance test name for pod creating with CPU and memory resources 2019-06-17 14:54:08 +05:30
Kubernetes Prow Robot
16bc6c1d02
Merge pull request #74982 from mgdevstack/promote-dns-hostname
Promote DNS e2e verifying DNS resolution for hostname and subdomain
2019-06-13 19:13:11 -07:00
Kubernetes Prow Robot
62eae8d058
Merge pull request #70639 from mgdevstack/promote-security-context
Promote security context NodeConformance tests to Conformance suite
2019-06-13 17:48:20 -07:00
globervinodhn
faf5cda046 Promote existing E2Es for hostport/HostIP resolution to conformance 2019-06-06 11:39:27 +05:30
Mayank Gaikwad
fc2af0e5a4 Promote e2e verifying DNS resolution for o pod's fqdn, hostname and subdomain 2019-05-14 23:53:00 +05:30