Commit Graph

3086 Commits

Author SHA1 Message Date
pacoxu
2360f228ab add lock for csi node update
Signed-off-by: pacoxu <paco.xu@daocloud.io>
2020-09-01 15:52:04 +08:00
Kubernetes Prow Robot
e23d83eead
Merge pull request #93710 from Jiawei0227/attachable2non
Detect volume attach-ability in the middle of attaching
2020-08-31 17:39:50 -07:00
ialidzhikov
2327e32839 Update max data disk count with new instance types
Signed-off-by: ialidzhikov <i.alidjikov@gmail.com>
2020-08-30 21:52:41 +03:00
Kubernetes Prow Robot
7abc47d315
Merge pull request #93136 from donggangcj/fix-static-check-error
fix(staticcheck): fix static error of package `/pkg/volume/gcepd`
2020-08-28 06:35:21 -07:00
Kubernetes Prow Robot
5760cef7a4
Merge pull request #92878 from jvanz/issue90293
cleanup: print warning message only if the function does not finish within 30 seconds
2020-08-27 19:07:55 -07:00
Kubernetes Prow Robot
2e59a17dc1
Merge pull request #92288 from zhijianli88/cleanup-tempfiles
Cleanup tempfiles
2020-08-27 17:56:54 -07:00
Kubernetes Prow Robot
b9c461afe5
Merge pull request #93852 from nikhita/cleanup-vsphere-owners
vsphere: remove inactive members from OWNERS
2020-08-27 06:42:21 -07:00
Jiawei Wang
a6d8e6c5c2 Detect change of volume attachability in the middle of attaching
- Add Unit tests for both volumemanager and attach/detach controller
- Add E2E test
2020-08-24 17:15:11 -07:00
andyzhangx
1b213c9053 fix: use sensitiveOptions on Windows mount 2020-08-20 07:31:07 +00:00
Jing Xu
5aa817ab43 Fix issue in evaluating symlink path for subpath
This PR tries to fix issue https://github.com/kubernetes/kubernetes/issues/93759
2020-08-14 19:39:55 -07:00
Nikhita Raghunath
53e87ddd15 vsphere: remove inactive members from OWNERS
As a part of cleaning up inactive members (who haven't been active since
beginning of 2019) from OWNERS files, this commit moves abrarshivani to
emeritus_approvers section.
2020-08-10 15:23:25 +05:30
Jordan Liggitt
f33dc28094 generated: hack/update-hack-tools.sh && hack/update-vendor.sh 2020-07-25 16:45:02 -04:00
José Guilherme Vanz
5ebb1c3be2
cleanup: print warning message after timeout
If a pod has a configmap/secret volume an annoying message shows up
in the log approximately every 70 seconds. This happens because the
desiredStateOfWorldPopulator sync loop always call the
MarkRemountRequired. The function finds the volume plugin and check
if the plugin requires mount. Configmap and secret plugins always
returns true for that. Thus, the reconciler code of the volume manager
remounts the volume every time. This commit change the SetVolumeOwnership
to print the warning only if the function does not finish within 30
seconds.

Signed-off-by: José Guilherme Vanz <jguilhermevanz@suse.com>
2020-07-20 22:46:11 -03:00
José Guilherme Vanz
08ccbe6f0e
Revert "cleanup: decrease log level from warn to v3"
This reverts commit ebece49936e635f151fdd8a64fa2b77fd183e817.
2020-07-20 22:46:11 -03:00
José Guilherme Vanz
9b9dcf3d84
cleanup: decrease log level from warn to v3
If a pod has a configmap/secret volume an annoying message shows up
in the log approximately every 70 seconds. This happens because the
desiredStateOfWorldPopulator sync loop always call the
MarkRemountRequired. The function finds the volume plugin and check
if the plugin requires mount. Configmap and secret plugins always
returns true for that. Thus, the reconciler code of the volume manager
remounts the volume every time. This commit decrease the log level of
that message in the mount function from warning to V4.

Signed-off-by: José Guilherme Vanz <jguilhermevanz@suse.com>
2020-07-20 22:46:11 -03:00
Phil Bracikowski
d880a1b78c AWS: increase io1 volume IOPs limit
Max IOPS for SSD (io1) volumes was increased from 20,000 to 32,000:
https://aws.amazon.com/about-aws/whats-new/2017/12/amazon-ebs-provisioned-iops-ssd--io1--volumes-now-support-32-000-iops-and-500-mbs-per-volume/

and later to 64,000:
https://aws.amazon.com/about-aws/whats-new/2018/11/amazon-elastic-block-store-announces-double-the-performance-of-provisioned-iops-volumes/
2020-07-20 17:41:13 -07:00
yuzhiquan
aca107eee5 Fixed potential nil dereference in hostpath unit test 2020-07-20 20:58:36 +08:00
yuzhiquan
a60cbd5535 Fixed error string should not be capitalized 2020-07-20 20:58:06 +08:00
Dong Gang
b30f6f30ed fix(staticcheck): fix static error of package /pkg/volume/gcepd
Signed-off-by: Dong Gang <dong.gang@daocloud.io>
2020-07-18 10:54:10 +08:00
Kubernetes Prow Robot
58893f3443
Merge pull request #93052 from andyzhangx/fix-initial-delay
fix: initial delay in mounting azure disk & file
2020-07-16 17:27:00 -07:00
Kubernetes Prow Robot
96c057ab48
Merge pull request #92001 from huffmanca/include-csidriver-fsgroup
Include CSIDriver capability to indicate fsGroup support
2020-07-16 09:11:42 -07:00
Kubernetes Prow Robot
d9c3d15018
Merge pull request #92986 from gnufied/fix-in-use-errors
Handle volume-in-use error during volume expansion
2020-07-15 00:30:37 -07:00
andyzhangx
82b8b07a2d fix: initial delay in mounting azure disk/file 2020-07-14 07:14:43 +00:00
Claudiu Belu
15ccf86e7c Windows: Fixes subpath symlink evaluation
Paths do not always have Targets, which means that the previously added powershell
command will return an empty string, causing pods with subpath mounts to fail.
2020-07-13 16:12:01 -07:00
Kubernetes Prow Robot
1bcf42b442
Merge pull request #92328 from jingxu97/June/evalpath
Replace evalSymlink() with powershell command for subPath_windows.go
2020-07-13 01:40:35 -07:00
Kubernetes Prow Robot
539b0a5a0f
Merge pull request #92905 from andyzhangx/deprecate-blobdis
doc: deprecate azure blob disk feature
2020-07-12 06:59:07 -07:00
Kubernetes Prow Robot
23903c7f7c
Merge pull request #92825 from ZeroMagic/azurefile-tag
Add tags support for Azure File Driver
2020-07-11 20:55:50 -07:00
Hemant Kumar
ade2f83685 Simplify the code 2020-07-11 23:29:24 -04:00
Christian Huffman
58bd3e5230 Include CSIDriver SupportsFsGroup 2020-07-11 23:29:24 -04:00
Hemant Kumar
b8c0435bc2 Handle volume-in-use error 2020-07-11 09:02:58 -04:00
Kubernetes Prow Robot
d9b084a9d1
Merge pull request #89629 from fatedier/subpath
Modified subpath configmap mount fails when container restarts
2020-07-09 09:06:32 -07:00
Kubernetes Prow Robot
55d77ade67
Merge pull request #92489 from alculquicondor/sig-storage-ownership
Add SIG storage owner aliases
2020-07-09 00:05:20 -07:00
ZeroMagic
7e7cf6a314 add tags support for azure file driver
Signed-off-by: ZeroMagic <jiliu8@microsoft.com>
2020-07-09 03:47:24 +00:00
andyzhangx
f007c68ae9 doc: deprecate azure blob disk feature 2020-07-08 10:48:58 +00:00
Aldo Culquicondor
27ec356d76 Add SIG storage owner aliases
And give ownership to pkg/scheduler/framework/plugins/volumebinding

Signed-off-by: Aldo Culquicondor <acondor@google.com>
Change-Id: I4bd89b1745a2be0e458601056ab905bdd6692195
2020-07-07 10:26:16 -04:00
Kubernetes Prow Robot
aaf40adcd0
Merge pull request #92461 from Haleygo/001
update static check failed from pkg/volume/rbd
2020-07-07 00:57:58 -07:00
Kubernetes Prow Robot
9e70d6f805
Merge pull request #91738 from jsafrane/fix-iscsi-metadata
iscsi: don't write json medata file when the volume is already mounted.
2020-07-04 16:06:48 -07:00
Hemant Kumar
6342dad709 Ensure that StagingPath is supplied to blockVolume expansion 2020-07-01 12:21:17 -04:00
Hemant Kumar
69613da0ae rename volumeid to volumeID 2020-07-01 11:34:31 -04:00
Hemant Kumar
75e13e370e Supply staging path for block expansion 2020-07-01 11:34:31 -04:00
Hemant Kumar
7d6959ce2c Add extra fields in node expansion CSI call 2020-07-01 11:34:31 -04:00
haleygo
d6cf8d3e57 update static check failed from pkg/volume/rbd
remove field from staticcheck_failures
2020-06-27 02:21:51 +08:00
haleygo
a5b7ce1bfd fix static check failed from pkg/volume/vspherevolume
remove field from staticcheck_failures
2020-06-27 02:03:13 +08:00
Kubernetes Prow Robot
a730ad56b9
Merge pull request #92345 from brianpursley/unmount-handle-not-found
Make unmount device log warning and continue if mount path is not found
2020-06-26 04:17:45 -07:00
Kubernetes Prow Robot
30dbfbec84
Merge pull request #92367 from gongguan/instancev2
define and implement cloud InstanceV2
2020-06-26 00:07:45 -07:00
Kubernetes Prow Robot
14c69640d0
Merge pull request #87166 from jingxu97/Jan/mountcheckfix
Fix issue in kubelet getMountedVolumePathListFromDisk
2020-06-25 09:45:39 -07:00
gongguan
22e083f132 implement instancesV2 2020-06-25 11:15:57 +08:00
Brian Pursley
4cc4e774c6 Make unmount device log warning and continue if mount path is not found 2020-06-24 10:02:50 -04:00
Jing Xu
b8ee3d2782 Replace evalSymlink() with powershell command for subPath_windows.go
In golang, evalSymlink() does not work if windows disk driver letter is
not assigned. Replace this function with a powershell command to work
around this issue.
2020-06-23 13:35:30 -07:00
Li Zhijian
02eaa4f354 cleanup tempfiles in unit test
Signed-off-by: Li Zhijian <lizhijian@cn.fujitsu.com>
2020-06-23 11:47:18 +08:00
Jing Xu
7012994a61 Fix issue in kubelet getMountedVolumePathListFromDisk
This PR fixes issue #74650. It adds the extra check for /mount dir under
pod volume dir. It also adds the unit test for this function
2020-06-22 10:00:43 -07:00
Kubernetes Prow Robot
27687161d9
Merge pull request #92356 from andyzhangx/azuredisk-tags
add tags support for azure disk driver
2020-06-22 04:26:39 -07:00
Kubernetes Prow Robot
0c571629ab
Merge pull request #92336 from andyzhangx/azurefile-protocol
add azurefile protocol  parameter in azure cloud provider lib
2020-06-21 22:22:39 -07:00
andyzhangx
9973b1cb5e feat: add tags support for azure disk driver
merge tags map
2020-06-21 13:04:06 +00:00
andyzhangx
42e378f86f chore: add azure file protocol parameter
fix typo

fix e2e test failure

fix comments
2020-06-21 03:36:01 +00:00
andyzhangx
b0cfc8f602 fix: update max azure disk max count 2020-06-20 03:25:53 +00:00
Jan Safranek
9a9c216825 iscsi: don't write json medata file when the volume is already mounted.
iSCSI volume plugin persists volume metadata into global mount directory,
before it is mounted. Content of the directory is shadowed by the volume
mount. Therefore kubelet should not write metadata to the directory when a
second pod uses the same volume on the same node.

1. The metadata were already persisted before mounting the volume for the
first pod.
2. The global mount directory has the volume mounted, so any write there
would write to the volume, which is undesirable.
2020-06-17 20:09:54 +02:00
fatedier
3089411183 autogen files update 2020-06-16 12:02:29 +08:00
fatedier
6c2562a579 fix 68211: modified subpath configmap mount fails when container restart 2020-06-16 11:37:43 +08:00
Kubernetes Prow Robot
98f250f883
Merge pull request #91307 from yuga711/attach
CSI: Modify VolumeAttachment check to use Informer/Cache
2020-06-15 08:10:10 -07:00
Jayasekhar Konduru
2a89577659 CSI: Modify VolumeAttachment check to use Informer/Cache
Change-Id: Ie70c8b6657c67eefbf13042f36d56ca84a2e42bb
2020-06-11 10:34:09 -07:00
Julian Taylor
da01c8d472 fix expanding rbd volumes without ceph.conf
Ignore stderr of rbd info --format=json as without a ceph.conf it will
print messages about no configuration onto stderr which break the
json parsing.

The actual json information the function wants is always on stdout.

Closes: gh-88643

Signed-off-by: Julian Taylor <juliantaylor108@gmail.com>
2020-06-11 11:14:09 +02:00
Divyen Patel
148ef06a3d vSphere in-tree volumes migration to vSphere CSI driver 2020-06-08 16:17:02 -07:00
Kubernetes Prow Robot
2fa00e30ce
Merge pull request #90985 from mrobson/iscsi-nodescan-manual
Set session scanning to manual to avoid discovering all iSCSI devices…
2020-05-20 16:45:15 -07:00
Kubernetes Prow Robot
c2ffe49fa6
Merge pull request #90894 from gongguan/cloud-instance
Implement InstanceMetadataByProviderID
2020-05-20 16:45:01 -07:00
Davanum Srinivas
07d88617e5
Run hack/update-vendor.sh
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-05-16 07:54:33 -04:00
Davanum Srinivas
442a69c3bd
switch over k/k to use klog v2
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2020-05-16 07:54:27 -04:00
louisgong
260a9005a0 define cloud-provider InstanceMetadata and InstanceMetadataByProviderID function 2020-05-16 14:16:46 +08:00
Kubernetes Prow Robot
ab207be846
Merge pull request #90608 from huffmanca/update-default-fstype-cinder
Updates the fstype of Cinder volumes to be ext4 if nil
2020-05-15 08:57:37 -07:00
Hemant Kumar
75fdb6d554 When casting resource.Quantity to int64 it may overflow
We need to ensure that when converting resource.Quantity
to int64 it does not overflow and if it does, then an error is
returned back to the use rather than attempting expansion and
provisioning operations with scaled value.
2020-05-13 21:22:59 -04:00
Kubernetes Prow Robot
5a5ae8d6ff
Merge pull request #90350 from ZeroMagic/update_azurefile
Switch to use AzureFile management SDK
2020-05-13 15:58:23 -07:00
mrobson
03892097fc Set session scanning to manual to avoid discovering all iSCSI devices during login
Move session scanning to before if !b.chapSession
2020-05-12 13:55:33 -04:00
ZeroMagic
01713f2411 chore: set resourceGroup into azure pv annotation
Signed-off-by: ZeroMagic <jiliu8@microsoft.com>
2020-05-12 05:34:27 +00:00
Ted Yu
1b9d6f46bf Append suffix 'i' only if needed
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2020-05-10 07:36:58 -07:00
ZeroMagic
f3a64e22d9 chore: switch to use AzureFile management SDK
Signed-off-by: ZeroMagic <jiliu8@microsoft.com>
2020-05-09 02:52:51 +00:00
Shihang Zhang
3db7275b54 set proper file permission for projected service account volume 2020-05-04 18:25:23 -07:00
Christian Huffman
a29fcc679f Updates the fstype of Cinder volumes to be ext4 if nil 2020-04-29 15:48:25 -04:00
Kubernetes Prow Robot
3c3497bed9
Merge pull request #89981 from gaurav1086/VolumeMode_nil_ptr_check
[volume] VolumeMode nil pointer check
2020-04-27 22:26:19 -07:00
Kubernetes Prow Robot
64d55ae13b
Merge pull request #90270 from gaurav1086/aws_block_test
[Provider/AWS] fix block test
2020-04-27 05:13:29 -07:00
Kubernetes Prow Robot
36eee3ca8a
Merge pull request #90080 from gaurav1086/gce_nil_ptr_check
[GCE] VolumeNode nil check
2020-04-25 12:17:29 -07:00
Gaurav Singh
3531283b70 Changed error message 2020-04-24 11:15:48 -04:00
Gaurav Singh
749839c050 Change the error message 2020-04-24 10:48:09 -04:00
Di Xu
084fe6de93 fix bug on checking hostpath type file 2020-04-23 10:52:40 +08:00
Gaurav Singh
d7a59d7694 Code review changes 2020-04-20 23:13:19 -04:00
Gaurav Singh
c41932e919 Code review changes 2020-04-20 23:05:05 -04:00
Gaurav Singh
903b98d2bf [AWS] fix block test 2020-04-18 18:56:59 -04:00
Kubernetes Prow Robot
4f2f51602e
Merge pull request #90081 from gaurav1086/linux_nil_ptr_check
[LINUX] call T.Fatalf() for nil ptr
2020-04-16 04:55:01 -07:00
Gaurav Singh
fe8d468633 call T.Fatalf() for nil ptr 2020-04-11 11:15:40 -04:00
Gaurav Singh
e84c415417 Correct error log message 2020-04-11 10:05:29 -04:00
Gaurav Singh
11d54320ac Correct error message 2020-04-11 10:02:56 -04:00
Gaurav Singh
a2e3a9f37a gce_correct_nil_check 2020-04-11 09:59:15 -04:00
Gaurav Singh
05149450d9 s/t.Errorf/t.Fatalf/ 2020-04-10 09:23:35 -04:00
Kubernetes Prow Robot
3d350d86d6
Merge pull request #81892 from praseodym/fix-staticcheck-pkg/volume
Fix staticcheck failures for pkg/volume/...
2020-04-09 20:03:48 -07:00
Mark Janssen
2c61627f8c Fix staticcheck failures for pkg/volume/...
Errors from staticcheck:
pkg/volume/azure_dd/azure_common.go:68:2: var winDiskNumFormat is unused (U1000)
pkg/volume/csi/csi_block.go:97:2: field volumeInfo is unused (U1000)
pkg/volume/csi/csi_block_test.go:56:6: func prepareBlockUnmapperTest is unused (U1000)
pkg/volume/csi/csi_client.go:108:2: const initialDuration is unused (U1000)
pkg/volume/csi/csi_client.go:109:2: const factor is unused (U1000)
pkg/volume/csi/csi_client.go:110:2: const steps is unused (U1000)
pkg/volume/csi/csi_client_test.go:83:8: this value of err is never used (SA4006)
pkg/volume/csi/csi_mounter.go:76:2: field options is unused (U1000)
pkg/volume/csi/csi_mounter_test.go:454:13: this value of err is never used (SA4006)
pkg/volume/csi/csi_plugin_test.go:766:16: this value of err is never used (SA4006)
pkg/volume/csi/csi_plugin_test.go:861:13: this value of err is never used (SA4006)
pkg/volume/csi/csi_plugin_test.go:1186:13: this value of err is never used (SA4006)
pkg/volume/csi/csi_plugin_test.go:1249:13: this value of err is never used (SA4006)
pkg/volume/csi/csi_test.go:305:5: the goroutine calls T.Fatalf, which must be called in the same goroutine as the test (SA2002)
pkg/volume/flexvolume/probe_test.go:67:10: this value of err is never used (SA4006)
pkg/volume/iscsi/iscsi_test.go:95:2: field attachCalled is unused (U1000)
pkg/volume/iscsi/iscsi_test.go:96:2: field detachCalled is unused (U1000)
pkg/volume/iscsi/iscsi_test.go:501:24: this value of err is never used (SA4006)
pkg/volume/iscsi/iscsi_util_test.go:159:2: this value of exist is never used (SA4006)
pkg/volume/local/local.go:351:57: argument devicePath is overwritten before first use (SA4009)
pkg/volume/plugins_test.go:119:2: this value of plug is never used (SA4006)
pkg/volume/plugins_test.go:125:2: this value of plug is never used (SA4006)
pkg/volume/quobyte/quobyte.go:474:23: this result of append is never used, except maybe in other appends (SA4010)
pkg/volume/quobyte/quobyte.go:477:23: this result of append is never used, except maybe in other appends (SA4010)
pkg/volume/quobyte/quobyte.go:480:23: this result of append is never used, except maybe in other appends (SA4010)
pkg/volume/rbd/rbd.go:886:2: field adminSecret is unused (U1000)
pkg/volume/rbd/rbd.go:887:2: field adminID is unused (U1000)
pkg/volume/rbd/rbd.go:888:2: field imageFormat is unused (U1000)
pkg/volume/rbd/rbd.go:889:2: field imageFeatures is unused (U1000)
pkg/volume/storageos/storageos.go:302:2: field secretName is unused (U1000)
pkg/volume/storageos/storageos_util_test.go:43:2: field apiAddr is unused (U1000)
pkg/volume/storageos/storageos_util_test.go:44:2: field apiUser is unused (U1000)
pkg/volume/storageos/storageos_util_test.go:45:2: field apiPass is unused (U1000)
pkg/volume/storageos/storageos_util_test.go:46:2: field apiVersion is unused (U1000)
pkg/volume/util/atomic_writer_test.go:756:49: argument err is overwritten before first use (SA4009)
pkg/volume/util/fsquota/common/quota_linux_common.go:37:2: const acct is unused (U1000)
pkg/volume/util/fsquota/common/quota_linux_common.go:38:2: const enforcing is unused (U1000)
pkg/volume/util/fsquota/project.go:168:31: identical expressions on the left and right side of the '==' operator (SA4000)
pkg/volume/util/fsquota/quota_linux.go:306:50: argument poduid is overwritten before first use (SA4009)
pkg/volume/util/fsquota/quota_linux_test.go:558:16: this value of err is never used (SA4006)
pkg/volume/util/subpath/subpath_linux.go:232:81: argument err is overwritten before first use (SA4009)
pkg/volume/util/subpath/subpath_linux_test.go:579:73: argument err is overwritten before first use (SA4009)
2020-04-09 22:08:07 +02:00
Gaurav Singh
2061924b0f [volume] VolumeMode nil pointer check 2020-04-08 17:09:13 -04:00
Kubernetes Prow Robot
60df45fa55
Merge pull request #89768 from andyzhangx/update-max-disk-count2
fix: get attach disk error due to missing item in max count table
2020-04-03 08:33:45 -07:00
Michelle Au
63ee9b3f4f Clean up event messages for errors.
Change-Id: Ib70b50e676b917c4d976f32ee7a19f8fc63b6bc6
2020-04-02 15:25:36 -07:00
andyzhangx
9b14d44aa5 fix: update max azure disk max count 2020-04-02 13:44:23 +00:00
Kubernetes Prow Robot
8d773421ee
Merge pull request #80973 from xiaoanyunfei/bugfix/orphan-volume
fix orphaned pod flexvolume  can not be cleaned up
2020-04-01 20:50:23 -07:00
Hemant Kumar
6362a616ec Force sgid bit to be off before checking volume permission 2020-04-01 11:20:38 -04:00