Commit Graph

20354 Commits

Author SHA1 Message Date
Patrick Ohly
5462d97e62 storage e2e: test snapshotting of generic ephemeral volumes
Conceptually, snapshots have to be taken while the pod and thus the volume
exist. Snapshotting has an issue where flushing of data is not guaranteed while
the volume is still staged on the node, so the test relied on deleting the pod
and checking for the volume to be unused. That part of the test cannot be done
for ephmeral volumes.
2021-10-19 14:01:21 +02:00
Patrick Ohly
7538d089d5 storage e2e: fix volume metric test for generic ephemeral volume
This is a fix for the new test case from
https://github.com/kubernetes/kubernetes/pull/105636 which had to be merged
without prior testing due to not having a cluster to test on and no pull job
which runs these
tests. https://testgrid.k8s.io/sig-storage-kubernetes#gce-serial then showed a
failure.

The fix is simple: in the ephemeral case, the PVC name isn't set in advance in
pvc.Name and instead must be computed. The fix now was tested on a kubetest
cluster in GCE.

Signed-off-by: Patrick Ohly <patrick.ohly@intel.com>
2021-10-19 14:01:21 +02:00
Patrick Ohly
4568cdada2 storage e2e: test volume attach limits of generic ephemeral volumes
There are unit tests for this particular code path in kube-scheduler, but no
E2E tests.
2021-10-19 14:01:20 +02:00
Patrick Ohly
a90a3c6a9c storage e2e: check raw block support for generic ephemeral volumes
This adds a new test pattern and uses it for the inline volume tests. Because
the kind of volume now varies more, validation of the mount or block device is
always done by the caller of TestEphemeral.
2021-10-19 13:30:32 +02:00
Shivanshu Raj Shrivastava
3e6d122ee1 fixed using reference to loop iterator (#105433)
* fixed using reference to loop iterator

* fixed other for loops
2021-10-19 02:40:38 -07:00
Yaakov Selkowitz
4e3f94eb41 test: use newer test images for better s390x coverage
These image versions added s390x builds via
https://github.com/kubernetes/kubernetes/pull/102785.
2021-10-18 23:00:31 -04:00
Kubernetes Prow Robot
b977200a5d Merge pull request #102785 from yselkowitz/master
Enable more test images for s390x
2021-10-18 19:59:34 -07:00
David Porter
d28db6ee0c Support cgroupv2 in node problem detector test 2021-10-18 19:50:45 -07:00
Namanl2001
85d16760f0 adding defaultGceKey in remote/ssh.go
Signed-off-by: Namanl2001 <namanlakhwani@gmail.com>
2021-10-19 00:07:36 +05:30
elbehery
04ad18ce44 Run storage hostpath e2e test client pod as privileged
hostPath volume plugin creates a directory within /tmp on host machine, to be mounted as volume.
inject-pod writes content to the volume, and a client-pod tried the read the contents and verify.
when SELinux is enabled on the host, client-pod can not read the content, with permission denied.
running the client-pod as privileged, so that it can access the volume content, even when SEinux is enabled on the host.
2021-10-18 15:06:20 +02:00
Haichao Li
ad7bceb31b glusterdynamic-provisioner: update to v1.3 and provide arm64 support
Signed-off-by: Haichao Li <Haichao.li@arm.com>
Change-Id: I809de5eee0f4cc2865bbf89ee9ad840497185019
2021-10-18 16:23:32 +08:00
Aldo Culquicondor
2c1b3fdb5b Graduate JobTrackingWithFinalizers to beta
Enable feature by default.

Update integration tests for other features to assume that finalizers are present.

Change-Id: Ie969344f572627dba882c0e862e5700dadaf3026
2021-10-15 10:29:40 -04:00
Francesco Romani
baa55935f3 node: e2e: clarify findKubeletService
Add docstrings to findKubeletService and restartKubelet,
fix typos along the way.
xref: https://github.com/kubernetes/kubernetes/pull/105516#pullrequestreview-780230582

Signed-off-by: Francesco Romani <fromani@redhat.com>
2021-10-15 11:19:03 +02:00
Kubernetes Prow Robot
fe62fcc9b4 Merge pull request #105516 from fromanirh/e2e-kubelet-restart-improvements
e2e: node: kubelet restart improvements
2021-10-14 17:58:54 -07:00
Kubernetes Prow Robot
fb2556cb34 Merge pull request #105670 from pohly/restore-volume-life-cycle-check
e2e: restore volume lifecycle check for most tests, II
2021-10-14 10:50:04 -07:00
Kubernetes Prow Robot
57aaa70b2c Merge pull request #105596 from pacoxu/subresource-remove
test fix: check correct subresource patch path
2021-10-14 10:49:48 -07:00
Kubernetes Prow Robot
dea052ceba Merge pull request #105479 from ahg-g/ahg-mutable
Allow updating scheduling directives of suspended jobs that never started
2021-10-14 08:09:18 -07:00
Abdullah Gharaibeh
335817cbce Allow updating node affinity, selector and tolerations for suspended jobs that never started 2021-10-14 10:04:47 -04:00
Kubernetes Prow Robot
f27e4714ba Merge pull request #105377 from damemi/wire-contexts-apps
Wire contexts to Apps controllers
2021-10-14 06:59:19 -07:00
Kubernetes Prow Robot
d09ce7be1c Merge pull request #105563 from mengjiao-liu/go1172
[go1.17] Update to go1.17.2
2021-10-14 03:25:19 -07:00
Patrick Ohly
5378b4d220 e2e: restore volume lifecycle check for most tests, II
Besides "subPath should unmount if pod is gracefully deleted while kubelet is
down" we also need a special case for "subPath should unmount if pod is force
deleted while kubelet is down".

This fixes a test failure in https://testgrid.k8s.io/sig-storage-kubernetes#gce-serial
2021-10-14 10:59:03 +02:00
Mengjiao Liu
19e8852154 [go1.17] Update to go1.17.2 2021-10-14 16:15:51 +08:00
Kubernetes Prow Robot
548e37278c Merge pull request #105313 from giuseppe/fix-flaky-pagefaults-summary-test
test, cgroupv2: adjust pagefaults test
2021-10-14 00:13:30 -07:00
Kubernetes Prow Robot
68f404b38f Merge pull request #105636 from pohly/generic-ephemeral-volume-metrics-tests
storage e2e: check metrics also for generic ephemeral volumes
2021-10-13 20:27:27 -07:00
Kubernetes Prow Robot
894ceb63d0 Merge pull request #105003 from swatisehgal/getallocatable-to-beta
podresource-api: getAllocatableResources to Beta
2021-10-13 17:43:27 -07:00
Mike Dame
41fcb95f2f Wire contexts to Apps controllers 2021-10-13 16:32:13 -04:00
Patrick Ohly
3df4cc67de storage e2e: check metrics also for generic ephemeral volumes
It shouldn't make any difference, but it's better to actually test that
assumption.

All existing tests which create pods get converted by skipping the explicit PVC
creation for the ephemeral case and instead modifying the test pod so that it
has a volume claim template with the same spec as the PVC.
2021-10-12 20:29:49 +02:00
Kubernetes Prow Robot
3271dff7b4 Merge pull request #105535 from soltysh/apps_cleanup
Move test utils where they belong
2021-10-12 08:11:48 -07:00
Maciej Szulik
8322121434 Move test-related utils to test/utils 2021-10-12 14:52:19 +02:00
Dave Chen
1500a5ca80 Simplify the integration test by removing the struct of nodeConfig
Signed-off-by: Dave Chen <dave.chen@arm.com>
2021-10-12 17:46:38 +08:00
Kubernetes Prow Robot
c2cbf5ff49 Merge pull request #105509 from ravisantoshgudimetla/fix-integration
[scheduler] [test]: Fix PreferNominatedNode test
2021-10-11 20:01:46 -07:00
Kubernetes Prow Robot
f83b16d93d Merge pull request #105052 from leiyiz/skip-storage-test
tag ginkgo tests affected by pdcsi migration for skipping
2021-10-11 13:09:02 -07:00
Patrick Ohly
a8c930ef46 generic ephemeral volume: graduation to GA
The feature gate gets locked to "true", with the goal to remove it in two
releases.

All code now can assume that the feature is enabled. Tests for "feature
disabled" are no longer needed and get removed.

Some code wasn't using the new helper functions yet. That gets changed while
touching those lines.
2021-10-11 20:54:20 +02:00
Paco Xu
abd13b131c test fix: check correct subresource patch path 2021-10-11 10:14:19 +08:00
Léiyì Zhang
822cc33955 tag ginkgo tests affected by pdcsi migration for skipping and add storageclass check for statefulset and upgrade tests 2021-10-09 17:33:56 +00:00
Kubernetes Prow Robot
835980ac67 Merge pull request #105424 from kerthcet/cleanup/remove-scheduler-policy-config
remove scheduler policy config
2021-10-08 10:57:23 -07:00
Kubernetes Prow Robot
76c86ce324 Merge pull request #105219 from sahilvv/ga_ttl
GA TTLAfterFinish
2021-10-08 09:38:59 -07:00
kerthcet
a6f695581b remove legacy scheduler policy config, as well as associated flags policy-config-file, policy-configmap, policy-configmap-namespace and use-legacy-policy-config
Signed-off-by: kerthcet <kerthcet@gmail.com>
2021-10-08 23:57:49 +08:00
Kubernetes Prow Robot
63f66e6c99 Merge pull request #105012 from fromanirh/cpumanager-policy-options-beta
node: graduate CPUManagerPolicyOptions to beta
2021-10-08 07:32:59 -07:00
Kubernetes Prow Robot
2face135c7 Merge pull request #97415 from AlexeyPerevalov/ExcludeSharedPoolFromPodResources
Return only isolated cpus in podresources interface
2021-10-08 05:58:58 -07:00
Kubernetes Prow Robot
60ab733932 Merge pull request #105546 from Huang-Wei/fix-evt-volumebinding
sched: adjust events to register for VolumeBinding plugin
2021-10-08 02:12:57 -07:00
Kubernetes Prow Robot
dd650bd41f Merge pull request #105527 from rphillips/fixes/filter_terminated_pods
kubelet: set terminated podWorker status for terminated pods
2021-10-07 22:19:51 -07:00
Ryan Phillips
3982fcae64 go fmt 2021-10-07 20:13:43 -05:00
Sahil Vazirani
3988405c8d GA TTLAfterFinish 2021-10-07 16:58:50 -07:00
Elana Hashman
c771698de3 Add e2e test to verify kubelet restart behaviour
Succeeded pods should not be counted as running on restart.
2021-10-07 18:30:17 -05:00
Kubernetes Prow Robot
956da16a8d Merge pull request #105344 from jonyhy96/add-benchmark-test
add benchmark test for replaceRegistryInImageURLWithList
2021-10-07 14:21:32 -07:00
Francesco Romani
d15bff2839 e2e: node: expose the running flag
Each e2e test knows it wants to restart a running kubelet or a
non-running kubelet. The vast majority of times, we want to
restart a running kubelet (e.g. to change config or to check
some properties hold across kubelet crashes/restarts), but sometimes
we stop the kubelet, do some actions and only then restart.

To accomodate both use cases, we just expose the `running` boolean
flag to the e2e tests.

Having the `restartKubelet` explicitly restarting a running kubelet
helps us to trobuleshoot e2e failures on which the kubelet
was supposed to be running, while it was not; attempting a restart
in such cases only murkied the waters further, making the
troubleshooting and the eventual fix harder.

In the happy path, no expected change in behaviour.

Signed-off-by: Francesco Romani <fromani@redhat.com>
2021-10-07 22:15:28 +02:00
Francesco Romani
e878c20ac7 e2e: node: improve error logging
In the `restartKubelet` helper, we use `exec.Command`, whose
return value is the output as the command, but as `[]byte`.
The way we logged the output of the command was as value, making
the output, meant to be human readable, unnecessarily hard to read.

We fix this annoying behaviour converting the output to string before
to log it out, making pretty obvious to understand the outcome of
the command.

Signed-off-by: Francesco Romani <fromani@redhat.com>
2021-10-07 22:13:49 +02:00
Kubernetes Prow Robot
9b45983d3c Merge pull request #104251 from ravisantoshgudimetla/scheduling-v1beta3
Scheduling v1beta3
2021-10-07 10:47:32 -07:00
Wei Huang
b7d90ca991 sched: adjust events to register for VolumeBinding plugin 2021-10-07 08:51:04 -07:00