Commit Graph

396 Commits

Author SHA1 Message Date
Kubernetes Prow Robot
70ca1dbb81 Merge pull request #107444 from sayaoailun/master
fix comment of e2e test case garbage_collector
2022-05-03 17:18:23 -07:00
Stephen Augustus
cddd83c997 Update Debian base images
- debian-base:bullseye-v1.2.0
- debian-iptables:bullseye-v1.3.0
- setcap:bullseye-v1.2.0

Signed-off-by: Stephen Augustus <foo@auggie.dev>
2022-04-13 16:23:54 -04:00
James Sturtevant
3d09201dbd Disable node->pod tests for Windows 2022-04-05 16:17:13 -07:00
Kubernetes Prow Robot
66369f47ec Merge pull request #109294 from Riaankl/NetworkPolicyStatus_endpoints
Add NetworkPolicyStatus to ineligible_endpoints.yaml
2022-04-05 13:33:49 -07:00
Kubernetes Prow Robot
a1a9dc066c Merge pull request #109256 from chendave/nullpointer
Fix the nil pointer dereference for comformance spec validation
2022-04-05 13:33:37 -07:00
Kubernetes Prow Robot
5163909f64 Merge pull request #108867 from pohly/storage-capacity-conformance
storage capacity conformance
2022-04-05 13:33:24 -07:00
Kubernetes Prow Robot
c13d3369d5 Merge pull request #109267 from ii/promote-job-status-test
Promote Read, Replace, Patch BatchV1NamespacedJobStatus test - +3 endpoints
2022-04-05 08:23:49 -07:00
Riaan Kleinhans
a4a6d70168 Add NetworkPolicyStatus to ineligible list 2022-04-05 07:36:38 +12:00
Kubernetes Prow Robot
a315ec3388 Merge pull request #108590 from claudiubelu/tests/enable-windows-tests
tests: Enables a few Conformance tests for Windows (part 1)
2022-04-04 08:56:11 -07:00
Patrick Ohly
556794d469 storage capacity: promote CRUD test to conformance 2022-04-04 07:53:05 +02:00
Stephen Heywood
c709baa9a0 Promote e2e job status test to Conformance 2022-04-04 13:22:57 +12:00
Dave Chen
1b5d8b0b9b Fix the nil pointer dereference for comformance spec validation
`verify-conformance-yaml.sh` is used to verify the test spec of
conformance e2e test are valid.

Bascically, it calls `e2e.test` binary to dump the test spec and
then walk the source to generate the `conformance.yaml`.

If the `e2e.test` binary is outdated, it's possible that `testInfo`
is nil.

Access the field from nil will result to `nil pointer dereference`

Signed-off-by: Dave Chen <dave.chen@arm.com>
2022-04-02 16:53:39 +08:00
Kevin Delgado
f234cb142a Adjust testing for server-side validation as default 2022-03-28 04:11:27 +00:00
Kubernetes Prow Robot
99e36a93b2 Merge pull request #108781 from SergeyKanzhelev/conformanceruntimeClass
RuntimeClass and PodOverhead tests promotion to Conformance
2022-03-23 22:31:41 -07:00
Sergey Kanzhelev
29e8bef315 RuntimeClass and PodOverhead promotion to GA 2022-03-17 21:49:32 +00:00
Aldo Culquicondor
2c5d0a273c Graduate IndexedJob to stable
- Lock feature gate to true and schedule for deletion in 1.26
- Remove checks on feature gate
- Graduate E2E test to Conformance

Change-Id: I6814819d318edaed5c86dae4055f4b050a4d39fd
2022-03-15 13:41:06 -04:00
Kubernetes Prow Robot
f9be590b25 Merge pull request #108431 from ii/promote-replace-podtemplate
Promote replaceCoreV1NamespacedPodTemplate test - +1 endpoint coverage
2022-03-14 16:24:58 -07:00
Riaan Kleinhans
454571b1bc add log endpoint to ineligible_endpoints.yaml 2022-03-14 09:59:21 +13:00
Claudiu Belu
87123c49a0 tests: Enables a few Conformance tests for Windows
Some of these tests could not be run previously, especially on Windows
Docker containers. But now, by using Windows Containerd, we can finally
run them:

- HostNetwork=true tests: This can now be enabled on Windows Privileged Containers.
- /etc/hosts related tests: These were not supported because it required single
  file mappings, which is possible in Containerd.
- termination message as non-root user: Requires RunAsUsername, and single file
  mappings.
2022-03-06 09:36:39 -08:00
Stephen Heywood
5597b0c4fb Promote replace podtemplate e2e test to Conformance 2022-03-02 10:33:02 +13:00
ahrtr
fe95aa614c io/ioutil has already been deprecated in golang 1.16, so replace all ioutil with io and os 2022-02-03 05:32:12 +08:00
sayaoailun
36697d2e5d fix comment of e2e test case garbage_collector
Signed-off-by: sayaoailun <guojianwei007@126.com>
2022-01-12 10:59:13 +08:00
Davanum Srinivas
9682b7248f OWNERS cleanup - Jan 2021 Week 1
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2022-01-10 08:14:29 -05:00
Kubernetes Prow Robot
1c2f24f106 Merge pull request #107349 from Riaankl/add-HPA-1
Update ineligible_endpoints.yaml to include HPA
2022-01-05 19:08:48 -08:00
Kubernetes Prow Robot
faf1590950 Merge pull request #107179 from hakman/remove_dockershim_tests
Clean up dockershim in tests
2022-01-05 13:54:21 -08:00
Riaan Kleinhans
d42d547f0f Update ineligible_endpoints.yaml 2022-01-06 09:52:27 +13:00
Kubernetes Prow Robot
2036bf0ba3 Merge pull request #106856 from pmorie/cronjob-e2e-typo
conformance: correct typo for cronjob forbidconcurrent
2022-01-04 11:27:14 -08:00
Ciprian Hacman
a0abe5aa33 Clean up dockershim in tests
Signed-off-by: Ciprian Hacman <ciprian@hakman.dev>
2021-12-22 13:05:34 +02:00
Kubernetes Prow Robot
87a54cbd3f Merge pull request #106313 from aojea/conformance
conformance tests should have at least 2 untainted nodes
2021-12-15 01:19:21 -08:00
Kubernetes Prow Robot
aed75bf2ed Merge pull request #106880 from ii/promote-proxy-301-redirect
Promote Pod- & ServiceProxy Test to Conformance - +12 endpoint coverage
2021-12-10 21:31:57 -08:00
Davanum Srinivas
9405e9b55e Check in OWNERS modified by update-yamlfmt.sh
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2021-12-09 21:31:26 -05:00
Stephen Heywood
27a247df85 Promote pod and service Proxy e2e test to Conformance 2021-12-08 15:21:40 +13:00
Paul Morie
48a84fe9c7 conformance: correct typo for cronjob forbidconcurrent 2021-12-07 16:55:03 -05:00
Kubernetes Prow Robot
203d145b6a Merge pull request #106281 from ii/promote-delete-service-collection
Promote DeleteCollection service e2e test to conformance - +1 endpoint
2021-11-18 07:47:03 -08:00
Aaron Crickenberger
357ad91d78 demote kubelet events test from Conformance
This test has been part of the Conformance suite since at least
Kubernetes 1.2 (2015-10-xx). Some years later, around 2018-10-xx, we
drafted a rigorous set of rules for tests to follow in order to be
eligible for promotion to Conformance. We explicitly disallowed any
tests that check for specific Events, since they are not an API, and we
make no guarantees about their contents nor their delivery.

Unfortunately, we neglected to go through the existing corpus of
Conformance tests with a fine-toothed comb after drafting these rules.
The very nature of what this test is attempting to exercise and verify
is specific Events, and their delivery, thus making it ineligible for
Conformance. We should have caught and demoted this test back then.

Better late than never?
2021-11-17 15:36:30 -08:00
Antonio Ojea
9723fbf3f1 conformance tests should have at least 2 untainted nodes 2021-11-10 16:32:30 +01:00
Stephen Heywood
675be94024 Promote DeleteCollection service e2e test to conformance 2021-11-10 10:19:46 +13:00
Kubernetes Prow Robot
c20ff9839e Merge pull request #97045 from claudiubelu/tests-windows-containerd-enabled
tests: Enable some [LinuxOnly] tests for Windows Containerd
2021-10-06 19:53:45 -07:00
Stephen Augustus
1a15eeef38 test/conformance/image: Update runner image to base-debian11
Signed-off-by: Stephen Augustus <foo@auggie.dev>
2021-09-20 21:05:06 -04:00
Stephen Augustus
531eb712c2 releng: Update build images to Debian 11 (Bullseye)
- debian-base:bullseye-v1.0.0
- debian-iptables:bullseye-v1.0.0
- go-runner:v2.3.1-go1.17.1-bullseye.0
- kube-cross:v1.23.0-go1.17.1-bullseye.0
- setcap:bullseye-v1.0.0

Signed-off-by: Stephen Augustus <foo@auggie.dev>
2021-09-20 20:51:32 -04:00
Kubernetes Prow Robot
af551a3b22 Merge pull request #105006 from Riaankl/Riaankl-change-upper_case-to-lower_case
update ineligible_endpoints removing upper case `Endpoint` to `endpoint`
2021-09-14 11:30:05 -07:00
Kubernetes Prow Robot
c7074017f7 Merge pull request #104948 from ishangupta-ds/test-conf-update
update github.com/pkg/errors in test/conformance/image/go-runner/ with native go pkg
2021-09-14 10:21:08 -07:00
Riaan Kleinhans
e675e74ce5 update ineligible_endpoints removing upper case 2021-09-15 02:05:08 +12:00
ishangupta-ds
c6b82bddd6 removing usage of github.com/pkg/errors from test/conformance/image/go-runner/ directory
Signed-off-by: ishangupta-ds <ishangupta.ds@gmail.com>

formatted using gofmt script

Signed-off-by: ishangupta-ds <ishangupta.ds@gmail.com>

adding nil check for error

Signed-off-by: ishangupta-ds <ishangupta.ds@gmail.com>

adding nil check for errors

Signed-off-by: ishangupta-ds <ishangupta.ds@gmail.com>

formatted

Signed-off-by: ishangupta-ds <ishangupta.ds@gmail.com>
2021-09-14 08:39:00 +05:30
Kubernetes Prow Robot
5cbe2656c5 Merge pull request #104978 from Riaankl/Riaankl-update-ineligible_enpoint-RBAC
Update ineligible_endpoint.yaml to include RBAC
2021-09-13 15:44:11 -07:00
Kubernetes Prow Robot
caf853b596 Merge pull request #104696 from PushkarJ/bump-conformance-images
Update conformance image to use debian-base:buster-v1.9.0
2021-09-13 13:28:02 -07:00
Riaan Kleinhans
6fa2859bf5 Update ineligible_endpoint.yaml to include RBAC 2021-09-14 08:02:49 +12:00
Pushkar Joglekar
8ed31517ff Bump conformance images to use debian:buster-v1.9.0
- Debian base used was older (v2.1.3)  missing multiple fixed CVEs
- Minor update to distroless debian image name to explicitly point
  to debian 10
- Debian base image now points to buster-1.9.0
2021-09-13 09:22:36 -07:00
Kubernetes Prow Robot
4e30c058c4 Merge pull request #104290 from nak3/fix-obsolete-link
Update obsolete link in the Conformance Test doc
2021-09-05 04:02:39 -07:00
Antonio Ojea
2a5ad65a9a e2e test apiserver endpoint and endpointslices
The e2e test "should have Endpoints and EndpointSlices pointing to
the API Server Service" was veryfing the current endpoints
reconciler implementation on the apiservers, however, users may
disable the endpoint reconciler and create their own.

This e2e test is also a conformance test, so we should test the
behaviour and not the implementation details. The test verifies
that a kubernetes.default service exist, an endpoint and endpoint
slices object referencing that service exist and are equivalent.
2021-08-31 11:29:06 +02:00