Commit Graph

1432 Commits

Author SHA1 Message Date
Mauricio Poppe
88165b02ba remove v1beta1 volume provisioning test 2021-05-18 20:46:57 +00:00
Masaki Kimura
382f37142c storage e2e: auto detect sector size 2021-05-11 22:32:05 +00:00
Jing Xu
89edde3b31 Add function to copy a single pod log in podlogs
The existing function in podlogs is copyAllLogs from a namespace. Add a
new function to copy log from a single pod.

Change-Id: I39d139a2a57d72a0af3432626b0c02c1b43333d2
2021-05-06 16:31:46 -07:00
Tomas Smetana
8773e0d491 Fix invalid AWS KMS key test flake 2021-04-28 13:22:49 +02:00
Kubernetes Prow Robot
21ab9c4175 Merge pull request #95286 from SergeyKanzhelev/removePodUnknown
Deprecating PodUnknown podPhase
2021-04-27 11:21:38 -07:00
Kubernetes Prow Robot
17f3990ea1 Merge pull request #100484 from gavinfish/e2e-storage-suffix
Remove suffixes for VolumeSnapshotClasses in E2E tests
2021-04-26 17:37:03 -07:00
Kubernetes Prow Robot
0e05558717 Merge pull request #101360 from pohly/hostpath-update
Revert "storage e2e: disable health check containers"
2021-04-22 17:44:14 -07:00
Kubernetes Prow Robot
2f6d79ca88 Merge pull request #100548 from mauriciopoppe/ephemeral-storage-e2e-windows
Make ephemeral volume tests work with Windows nodes
2021-04-22 17:44:01 -07:00
Kubernetes Prow Robot
82d8d08c78 Merge pull request #101280 from huffmanca/address-snapshotting-flakes
Force NodeUnstageVolume to finish for all distros
2021-04-22 02:32:31 -07:00
Patrick Ohly
3299469437 Revert "storage e2e: disable health check containers"
This reverts commit 0c2cee5676e64976f9e767f40c4c4750a8eeb11f.

The health check containers are not required for any test, but we want
to run them anyway to ensure that they cause no unexpected issues.
2021-04-22 08:20:39 +02:00
Kubernetes Prow Robot
1f87e3fe00 Merge pull request #101347 from verult/subpath-configmap-timeout
Extend pod start timeout to 5min for storage subpath configmap test
2021-04-21 21:12:46 -07:00
Kubernetes Prow Robot
d907c29956 Merge pull request #100637 from pohly/hostpath-update
storage e2e: automate hostpath YAML updates, update sidecars but not driver
2021-04-21 21:12:33 -07:00
Cheng Xing
4cfb6e2c23 Extend pod start timeout to 5min for storage subpath configmap test 2021-04-21 17:24:09 -07:00
Christian Huffman
21ea9af37f Force NodeUnstageVolume to finish for all distros 2021-04-21 15:01:41 -04:00
Patrick Ohly
c794b5c442 storage e2e: patch in RBAC rules for secrets
In one mock test, the snapshotter needs permission to read
secrets. That was disabled in the RBAC files of recent releases. We
need to patch it back in during deployment.
2021-04-21 09:57:54 +02:00
Patrick Ohly
7682e39a47 storage e2e: disable health check containers
They are not needed for any of the tests and in practice apparently
caused enough overhead that even unrelated tests timed out. For
example, in the pull-kubernetes-e2e-kind test, 43 out of 5771 tests
failed, including tests from sig-node, sig-cli, sig-api-machinery,
sig-network.
2021-04-20 08:07:15 +02:00
Patrick Ohly
446c1136dc storage e2e: automate hostpath YAML updates, hostpath v1.6.2
Mirroring the various YAML files by hand is tedious. The new
update-hostpath.sh does all the necessary steps automatically.

The result is now a bit more consistent with the upstream repos in the
sense that the original file names and paths for the RBAC YAML files
are used.

The csi-hostpath-testing.yaml is included for the sake of
completeness, but not used during E2E testing.

The new hostpath driver release is v1.6.2, which adds the
external-health-monitor for the first time.
2021-04-20 08:07:15 +02:00
Patrick Ohly
93d1e373eb storage e2e: remove obsolete function
SkipRedundantSuite was replaced by SkipUnsupportedTests. We don't need
both.
2021-04-19 11:11:47 +02:00
Kubernetes Prow Robot
27a625cf89 Merge pull request #100724 from liggitt/eviction-v1beta1
Add policy/v1 Eviction support
2021-04-16 10:02:22 -07:00
Kubernetes Prow Robot
97bdd7b9eb Merge pull request #100377 from mauriciopoppe/storage-windows-e2e-tests
Fix "Pod Disks schedule pods each with a PD" test in windows
2021-04-15 23:22:22 -07:00
Jordan Liggitt
33ad842480 allow evictions subresource to accept policy/v1 and policy/v1beta1 2021-04-13 21:22:25 -04:00
Kubernetes Prow Robot
4959cd6339 Merge pull request #100671 from Niekvdplas/spelling-mistakes
Fixed several spelling mistakes
2021-04-09 05:19:45 -07:00
Kubernetes Prow Robot
c081e70656 Merge pull request #100356 from mauriciopoppe/storage-windows-tests
Disable intree storage multivolume e2e test in windows nodes
2021-04-08 20:30:12 -07:00
Kubernetes Prow Robot
bb0906dcb2 Merge pull request #99929 from lala123912/lint_clean
Remove unused/dead code
2021-04-08 16:00:34 -07:00
Sergey Kanzhelev
4b05fe6644 podUnknown is marked as Obsolete 2021-04-06 22:43:08 +00:00
Mauricio Poppe
1e1252ed8c use LinuxOnly annotation instead of e2eskipper to skip windows tests 2021-04-05 20:21:53 +00:00
Mauricio Poppe
55bed0bb66 skip default storageclass test with windows nodes 2021-03-31 17:21:57 +00:00
Niekvdplas
fec272a7b2 Fixed several spelling mistakes 2021-03-30 23:02:09 +02:00
Kubernetes Prow Robot
2eb6911e83 Merge pull request #94334 from RaunakShah/volume_provision_perf
Add e2e test to validate performance metrics of volume lifecycle operations
2021-03-24 23:47:29 -07:00
Kubernetes Prow Robot
533931cfe5 Merge pull request #100549 from RaunakShah/fix_snapshot_cleanup
Fix check before deleting PV in Snapshot e2e test
2021-03-24 21:41:29 -07:00
shahra
6a97ff529d Fix check before deleting PV in Snapshot e2e test 2021-03-24 18:34:44 -07:00
Mauricio Poppe
7455b1ae94 update ephemeral volume tests with windows 2021-03-25 00:13:52 +00:00
Patrick Ohly
d7a086ddd8 storage e2e: simplify CSIStorageCapacity test
We can support topology detection for all drivers with a single
topology key by allowing different nodes to have the same topology
value. This makes the test a bit more generic and its configuration
simpler.
2021-03-24 22:31:43 +01:00
shahra
34e4a5f22c Add e2e test to validate performance metrics of volume lifecycle operations.
This test currently validates latency and throughput of volume
provisioning against a high baseline.
2021-03-24 13:50:32 -07:00
Patrick Ohly
b9b5d13b6d storage e2e: verify CSIStorageCapacity publishing
Drivers need to opt into the new test. Depending on how the driver
describes its behavior, the check can be more specific. Currently it
distinguishes between getting any kind of information about the
storage class (i.e. assuming that capacity is not exhausted) and
getting one object per node (for local storage). Discovering nodes
only works for CSI drivers.

The immediate usage of this new test is for csi-driver-host-path with
the deployment for distributed provisioning and storage capacity
tracking. Periodic kubernetes-csi Prow and pre-merge jobs can run this
test.

The alternative would have been to write a test that manages the
deployment of the csi-driver-host-path driver itself, i.e. use the E2E
manifests. But that would have implied duplicating the
deployments (in-tree and in csi-driver-host-path) and then changing
kubernetes-csi Prow jobs to somehow run for in-tree driver definition
with newer components, something that currently isn't done. The test
then also wouldn't be applicable to out-of-tree driver deployments.

Yet another alternative would be to create a separate E2E test suite
either in csi-driver-host-path or external-provisioner. The advantage
of such an approach is that the test can be written exactly for the
expected behavior of a deployment and thus be more precise than the
generic version of the test in k/k. But this again wouldn't be
reusable for other drivers and also a lot of work to set up as no such
E2E test suite currently exists.
2021-03-24 18:18:27 +01:00
drfish
244d7a5d67 Remove suffixes for VolumeSnapshotClasses in E2E tests 2021-03-23 21:24:28 +08:00
Mauricio Poppe
2ac6d4d133 fix Pod Disks schedule pods each with a PD test in windows 2021-03-18 17:19:09 +00:00
Mauricio Poppe
c95975d3f3 wait until the node is not using the volume before taking a snapshot 2021-03-16 16:09:38 +00:00
Kubernetes Prow Robot
bd23f4ff1e Merge pull request #99888 from mauriciopoppe/storage-windows-tests
Refactor on windows e2e storage related tests
2021-03-15 19:40:34 -07:00
Mauricio Poppe
5d9053014e Update tests to use common pod functions from framework/pod/utils.go 2021-03-11 07:25:56 +00:00
Shihang Zhang
4ad1c71174 graduate CSIServiceAccountToken to beta 2021-03-09 18:36:35 -08:00
Patrick Ohly
25f4174148 testdata: drop the alpha EphemeralVolumeSource.ReadOnly field
This is the result of
   UPDATE_COMPATIBILITY_FIXTURE_DATA=true go test k8s.io/api
after removing the ReadOnly field from the API. The test data
for older releases must be updated because the current code
no longer supports that field.

The removal itself is okay because the struct was declared
as alpha.

Because EphemeralVolumeSource is embedded quite a lot, different types
are affected. Here is one example:

       --- FAIL: TestCompatibility/extensions.v1beta1.DaemonSet/v1.20.0 (0.04s)
            compatibility.go:476: json differs
            compatibility.go:477:   string{
                  	... // 12941 identical bytes
                  	0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x7d, //  |               }|
                  	0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x7d, //  |.              }|
                - 	0x2c, 0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, // -|,.              |
                - 	0x22, 0x72, 0x65, 0x61, 0x64, 0x4f, 0x6e, 0x6c, 0x79, 0x22, 0x3a, 0x20, 0x74, 0x72, 0x75, 0x65, // -|"readOnly": true|
                  	0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x7d, 0x0a, 0x20, //  |.            }. |
                  	0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x7d, 0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, //  |         }.     |
                  	... // 31426 identical bytes
                  }

            compatibility.go:482: yaml differs
            compatibility.go:483:   string{
                  	... // 22893 identical bytes
                  	0x34, 0x22, 0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x65, 0x70, 0x68, 0x65, 0x6d, //  |4".        ephem|
                  	0x65, 0x72, 0x61, 0x6c, 0x3a, 0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, //  |eral:.          |
                - 	0x72, 0x65, 0x61, 0x64, 0x4f, 0x6e, 0x6c, 0x79, 0x3a, 0x20, 0x74, 0x72, 0x75, 0x65, 0x0a, 0x20, // -|readOnly: true. |
                - 	0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20,                                           // -|         |
                  	0x76, 0x6f, 0x6c, 0x75, 0x6d, 0x65, 0x43, 0x6c, 0x61, 0x69, 0x6d, 0x54, 0x65, 0x6d, 0x70, 0x6c, //  |volumeClaimTempl|
                  	0x61, 0x74, 0x65, 0x3a, 0x0a, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, 0x20, //  |ate:.           |
                  	... // 5965 identical bytes
                  }

            compatibility.go:488: proto differs
            compatibility.go:490:   (
                  	"""
                  	... // 459 identical lines
                  	                }
                  	              }
                - 	              2: 1
                  	            }
                  	          }
                  	... // 1083 identical lines
                  	"""
                  )

            compatibility.go:506: wrote expected compatibility data... verify, commit, and rerun tests
2021-03-09 08:24:52 +01:00
Patrick Ohly
555d4a12bf generic ephemeral volumes: drop ReadOnly field
As discussed during the alpha review, the ReadOnly field is not really
needed because volume mounts can also be read-only. It's a historical
oddity that can be avoided for generic ephemeral volumes as part
of the promotion to beta.
2021-03-09 08:22:48 +01:00
lala123912
127b675a15 Remove unused/dead code 2021-03-09 09:34:37 +08:00
Patrick Ohly
4c7e4c6316 CSIStorageCapacity: enable E2E tests by default
With the feature now in beta, tests should run in the normal jobs.
2021-03-08 20:59:52 +01:00
Patrick Ohly
5ca0814165 CSIStorageCapacity: use beta API 2021-03-08 20:52:50 +01:00
Kubernetes Prow Robot
8e6c7b5825 Merge pull request #99204 from pohly/podlog-after-termination
test: err more towards ignoring logs from terminated pods
2021-03-08 11:04:38 -08:00
Kubernetes Prow Robot
42c1ccb38e Merge pull request #99701 from wojtek-t/cleanup_describe_13
Tag storage windows tests with [Feature:Windows] instead of [sig-windows]
2021-03-05 10:00:47 -08:00
Kubernetes Prow Robot
f13c70e864 Merge pull request #99710 from wojtek-t/cleanup_describe_15
Remove nested SIGDescribe calls
2021-03-04 00:29:47 -08:00
Kubernetes Prow Robot
fd95f6f4ae Merge pull request #99709 from wojtek-t/cleanup_describe_14
Make sig-storage be the owner of ubernetes_lite_volumes test
2021-03-04 00:29:39 -08:00