Commit Graph

415 Commits

Author SHA1 Message Date
Stephen Heywood
1c9ae32103 Promote Event e2e test to Conformance
In promoting this e2e test to conformance it will
supersede e2e test "Event resource lifecycle", which
has been removed in this PR.
2022-07-25 09:15:36 +12:00
Kubernetes Prow Robot
9dc13f4f57
Merge pull request #111011 from ii/promote-patch-pod-status-test
Promote patchCoreV1NamespacedPodStatus test - +1 endpoint
2022-07-08 09:07:52 -07:00
Dave Chen
2f3028c00d Define the timeout to 24h for Ginkgo V2
Default timeout setting has been reduced from `24h` down to `1h` in
Ginkgo V2, but for some long running test this is too short.

How long to abort the test was controlled by the the linux command `timeout`
in V1. e.g. `'timeout -k 30s 150m ...`, and is configured in the file
like `sig-network-misc.yaml`.

Set the timeout manually for Ginkgo V2 to avoid the early aborting.

Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-07-08 10:46:11 +08:00
Dave Chen
20498fd65d Generate conformance test spec with offset decorator
`FullStackTrace` is not available in v2 if no exception found
with test execution.

The change is needed for conformance test's spec validation.

pls see: https://github.com/onsi/ginkgo/issues/960 for details.

Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-07-08 10:46:11 +08:00
Dave Chen
b57bade50c Switch to use dry-run option to generate test spec
`dryRun` option is deprecated and will not be able to
generate test spec.

Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-07-08 10:46:11 +08:00
Dave Chen
375b2a5fb2 Build Ginkgo binary
Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-07-08 10:46:11 +08:00
Dave Chen
857458cfa5 update ginkgo from v1 to v2 and gomega to 1.19.0
- update all the import statements
- run hack/pin-dependency.sh to change pinned dependency versions
- run hack/update-vendor.sh to update go.mod files and the vendor directory
- update the method signatures for custom reporters

Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-07-08 10:44:46 +08:00
Stephen Heywood
c288ebe53c Promote PodStatus e2e test to Conformance 2022-07-08 11:51:58 +12:00
Kubernetes Prow Robot
92c5f3f01c
Merge pull request #110583 from Riaankl/node_status_ineligible
Update ineligible_endpoints.yaml
2022-06-16 12:33:04 -07:00
Riaan Kleinhans
39d3d9439f
Update ineligible_endpoints.yaml 2022-06-17 06:24:35 +12:00
Riaan Kleinhans
6d19ddc7bf
Update ineligible_endpoints.yaml 2022-06-15 10:27:33 +12:00
Wes Panther
6ac853fe60 Update Debian base images to latest
- debian-base:bullseye-v1.3.0
- debian-iptables:bullseye-v1.4.0
- setcap:bullseye-v1.3.0
2022-06-13 21:36:46 -07:00
Kubernetes Prow Robot
b4fbd12c3a
Merge pull request #106441 from yjjy0921/master
create resultsDir if the folder not exists
2022-06-01 13:39:46 -07:00
Davanum Srinivas
50bea1dad8
Move from k8s.gcr.io to registry.k8s.io
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-05-31 10:16:53 -04:00
Kubernetes Prow Robot
5e9a6a256e
Merge pull request #109464 from liggitt/gomodule-install
Use module mode when building/installing
2022-05-05 16:28:52 -07:00
Kubernetes Prow Robot
f853a05e24
Merge pull request #109534 from ii/promote-job-lifecycle-test
Promote Batchv1JobLifecycleTest +4 Endpoints
2022-05-05 10:50:21 -07:00
Jordan Liggitt
2a10ca650d drop vendor from test targets 2022-05-05 08:47:33 -04:00
Kubernetes Prow Robot
70ca1dbb81
Merge pull request #107444 from sayaoailun/master
fix comment of e2e test case garbage_collector
2022-05-03 17:18:23 -07:00
Stephen Heywood
18d33db623 Promote e2e job lifecycle test to Conformance 2022-04-19 09:35:27 +12:00
Stephen Augustus
cddd83c997
Update Debian base images
- debian-base:bullseye-v1.2.0
- debian-iptables:bullseye-v1.3.0
- setcap:bullseye-v1.2.0

Signed-off-by: Stephen Augustus <foo@auggie.dev>
2022-04-13 16:23:54 -04:00
James Sturtevant
3d09201dbd Disable node->pod tests for Windows 2022-04-05 16:17:13 -07:00
Kubernetes Prow Robot
66369f47ec
Merge pull request #109294 from Riaankl/NetworkPolicyStatus_endpoints
Add NetworkPolicyStatus to ineligible_endpoints.yaml
2022-04-05 13:33:49 -07:00
Kubernetes Prow Robot
a1a9dc066c
Merge pull request #109256 from chendave/nullpointer
Fix the nil pointer dereference for comformance spec validation
2022-04-05 13:33:37 -07:00
Kubernetes Prow Robot
5163909f64
Merge pull request #108867 from pohly/storage-capacity-conformance
storage capacity conformance
2022-04-05 13:33:24 -07:00
Kubernetes Prow Robot
c13d3369d5
Merge pull request #109267 from ii/promote-job-status-test
Promote Read, Replace, Patch BatchV1NamespacedJobStatus test - +3 endpoints
2022-04-05 08:23:49 -07:00
Riaan Kleinhans
a4a6d70168
Add NetworkPolicyStatus to ineligible list 2022-04-05 07:36:38 +12:00
Kubernetes Prow Robot
a315ec3388
Merge pull request #108590 from claudiubelu/tests/enable-windows-tests
tests: Enables a few Conformance tests for Windows (part 1)
2022-04-04 08:56:11 -07:00
Patrick Ohly
556794d469 storage capacity: promote CRUD test to conformance 2022-04-04 07:53:05 +02:00
Stephen Heywood
c709baa9a0 Promote e2e job status test to Conformance 2022-04-04 13:22:57 +12:00
Dave Chen
1b5d8b0b9b Fix the nil pointer dereference for comformance spec validation
`verify-conformance-yaml.sh` is used to verify the test spec of
conformance e2e test are valid.

Bascically, it calls `e2e.test` binary to dump the test spec and
then walk the source to generate the `conformance.yaml`.

If the `e2e.test` binary is outdated, it's possible that `testInfo`
is nil.

Access the field from nil will result to `nil pointer dereference`

Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-04-02 16:53:39 +08:00
Kevin Delgado
f234cb142a Adjust testing for server-side validation as default 2022-03-28 04:11:27 +00:00
Kubernetes Prow Robot
99e36a93b2
Merge pull request #108781 from SergeyKanzhelev/conformanceruntimeClass
RuntimeClass and PodOverhead tests promotion to Conformance
2022-03-23 22:31:41 -07:00
Sergey Kanzhelev
29e8bef315 RuntimeClass and PodOverhead promotion to GA 2022-03-17 21:49:32 +00:00
Aldo Culquicondor
2c5d0a273c Graduate IndexedJob to stable
- Lock feature gate to true and schedule for deletion in 1.26
- Remove checks on feature gate
- Graduate E2E test to Conformance

Change-Id: I6814819d318edaed5c86dae4055f4b050a4d39fd
2022-03-15 13:41:06 -04:00
Kubernetes Prow Robot
f9be590b25
Merge pull request #108431 from ii/promote-replace-podtemplate
Promote replaceCoreV1NamespacedPodTemplate test - +1 endpoint coverage
2022-03-14 16:24:58 -07:00
Riaan Kleinhans
454571b1bc
add log endpoint to ineligible_endpoints.yaml 2022-03-14 09:59:21 +13:00
Claudiu Belu
87123c49a0 tests: Enables a few Conformance tests for Windows
Some of these tests could not be run previously, especially on Windows
Docker containers. But now, by using Windows Containerd, we can finally
run them:

- HostNetwork=true tests: This can now be enabled on Windows Privileged Containers.
- /etc/hosts related tests: These were not supported because it required single
  file mappings, which is possible in Containerd.
- termination message as non-root user: Requires RunAsUsername, and single file
  mappings.
2022-03-06 09:36:39 -08:00
Stephen Heywood
5597b0c4fb Promote replace podtemplate e2e test to Conformance 2022-03-02 10:33:02 +13:00
ahrtr
fe95aa614c io/ioutil has already been deprecated in golang 1.16, so replace all ioutil with io and os 2022-02-03 05:32:12 +08:00
sayaoailun
36697d2e5d fix comment of e2e test case garbage_collector
Signed-off-by: sayaoailun <guojianwei007@126.com>
2022-01-12 10:59:13 +08:00
Davanum Srinivas
9682b7248f
OWNERS cleanup - Jan 2021 Week 1
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-01-10 08:14:29 -05:00
Kubernetes Prow Robot
1c2f24f106
Merge pull request #107349 from Riaankl/add-HPA-1
Update ineligible_endpoints.yaml to include HPA
2022-01-05 19:08:48 -08:00
Kubernetes Prow Robot
faf1590950
Merge pull request #107179 from hakman/remove_dockershim_tests
Clean up dockershim in tests
2022-01-05 13:54:21 -08:00
Riaan Kleinhans
d42d547f0f
Update ineligible_endpoints.yaml 2022-01-06 09:52:27 +13:00
Kubernetes Prow Robot
2036bf0ba3
Merge pull request #106856 from pmorie/cronjob-e2e-typo
conformance: correct typo for cronjob forbidconcurrent
2022-01-04 11:27:14 -08:00
Ciprian Hacman
a0abe5aa33 Clean up dockershim in tests
Signed-off-by: Ciprian Hacman <ciprian@hakman.dev>
2021-12-22 13:05:34 +02:00
Kubernetes Prow Robot
87a54cbd3f
Merge pull request #106313 from aojea/conformance
conformance tests should have at least 2 untainted nodes
2021-12-15 01:19:21 -08:00
Wei Cao
6f45cbd7a5 create resultsDir if the folder not exists 2021-12-14 18:02:58 +08:00
Kubernetes Prow Robot
aed75bf2ed
Merge pull request #106880 from ii/promote-proxy-301-redirect
Promote Pod- & ServiceProxy Test to Conformance - +12 endpoint coverage
2021-12-10 21:31:57 -08:00
Davanum Srinivas
9405e9b55e
Check in OWNERS modified by update-yamlfmt.sh
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2021-12-09 21:31:26 -05:00