Commit Graph

638 Commits

Author SHA1 Message Date
saad-ali
a679486a5e Register CSI CRDs as addon 2018-11-06 10:58:09 -08:00
Mike Danese
8c1e928501 gce: move more stuff into main and refactor detect whether configure-helpers.sh was sourced 2018-10-31 10:07:50 -07:00
Mark Wolters
c9d34073f2 Changed prepare-log-file to take args for setting uid/gid for log files. 2018-10-19 11:57:26 -07:00
k8s-ci-robot
1aef63124b
Merge pull request #68920 from qingling128/master
Enable insertId generation, and update Stackdriver Logging Agent image to 0.5-1.5.36-1-k8s.
2018-10-11 13:44:51 -07:00
Walter Fender
8b3099ced7 Differentiate multizone zonal from Regional Cluster.
Fixed go format and unit test.
Collapse lines.
Switched to using regional throughout and added warning for HA Zonal.
2018-10-09 11:28:22 -07:00
Ling Huang
d8da1baf48 Enable insertId generation, update Stackdriver Logging Agent image to 0.5-1.5.36-1-k8s and add priorityClassName for Metadata Agent. 2018-10-09 13:42:40 -04:00
wojtekt
3fdb5b92f4 Fix overwriting env variables in kube-apiserver manifest 2018-10-08 14:21:37 +02:00
k8s-ci-robot
5602ab7761
Merge pull request #68379 from immutableT/kms-plugin-via-gke
Enable configure-helper.sh to support two scenarios for etcd level encryption: decryption and adding encryption to existing clusters.
2018-10-04 23:38:42 -07:00
immutablet
4bc62be0e6 Run kms-plugin in its own POD. 2018-10-04 09:19:57 -07:00
Marian Lobur
5a118f9d2f Extract cpu requests to separate env variables. 2018-10-02 07:54:39 +02:00
k8s-ci-robot
2a544bc709
Merge pull request #68565 from vantuvt/vantuvt-patch-1
Bug fix - revert metrics-server base CPU resources back to 40 mCPU
2018-10-01 10:59:15 -07:00
Van Tu
d3b4f2dac4 Bug fix - revert metrics-server base CPU resources back to 40 mCPU
The reduction in base CPU resources resulted in a significant increase in
start times from ~30 second to 1-4 minutes.
2018-09-28 06:18:39 -04:00
k8s-ci-robot
74e6ee1d34
Merge pull request #67174 from charrywanganthony/auditv1beta1Tov1_gce.sh
use v1 version of advanced audit policy in gce shell
2018-09-24 13:19:44 -07:00
k8s-ci-robot
b33b0fb093
Merge pull request #68615 from loburm/revert_cpu_decrease
Revert "#67504: Decrease CPU requests of master components in two times."
2018-09-20 12:31:17 -07:00
k8s-ci-robot
48203db09a
Merge pull request #68387 from Katharine/logdump-with-coverage
Add coverage profile retrieval to log dumps
2018-09-18 22:34:30 -07:00
Marian Lobur
1deb5acc2f Revert cpu resource decrease. 2018-09-13 11:13:07 +02:00
Kubernetes Submit Queue
59bcf0dadf
Merge pull request #67950 from dims/remove-e2e-image-puller
Automatic merge from submit-queue (batch tested with PRs 67950, 68195). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Remove e2e-image-puller

**What this PR does / why we need it**:

A long time ago, We added the image prepulling as a workaround due to
the overwhelming amount of flake caused by pulling during the tests.
This functionality has been broken for a while now when we switched to a
COS image where mounting `docker` binary into `busybox` stopped working.
So we just have dead code we should clean up.

Change-Id: I538171a5c1d9361eee7f9e0a99655b88b1721e3e

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #63355

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2018-09-07 11:19:36 -07:00
Katharine Berry
e17499c8e6 Include coverage information when dumping logs. 2018-09-06 16:24:32 -07:00
Kubernetes Submit Queue
5878b2877f
Merge pull request #68256 from mikedanese/nourand
Automatic merge from submit-queue (batch tested with PRs 68087, 68256, 64621, 68299, 68296). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

gce: use getrandom instead of urandom for on node rng

```release-note
NONE
```
2018-09-06 14:49:36 -07:00
Kubernetes Submit Queue
e2e60d2707
Merge pull request #68161 from tallclair/runtimeclass-addon
Automatic merge from submit-queue (batch tested with PRs 68161, 68023, 67909, 67955, 67731). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Register RuntimeClass CRD as an addon

**What this PR does / why we need it**:

Register the RuntimeClass CRD when the RuntimeClass feature gate is enabled. This is done in through the addon manager.

This is an alternative approach to https://github.com/kubernetes/kubernetes/pull/67924

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
For https://github.com/kubernetes/features/issues/585

**Release note**:
Covered by #67737
```release-note
NONE
```

/sig node
/kind feature
/priority important-soon
/milestone v1.12
2018-09-05 14:51:41 -07:00
Mike Danese
eac0410e45 gce: use getrandom instead of urandom for on node rng
In the context, our urandoms where generally safe, however getrandom has
built in invariants around entropy pool initialization, making getrandom
safe in all contexts. This should protect us from cryptopasta errors or
weird entropy issues.
2018-09-05 10:20:26 -07:00
Mike Danese
ad0208d720 gke: fix failing e2e tests 2018-09-04 21:58:02 -07:00
Kubernetes Submit Queue
4b4e1bec69
Merge pull request #67736 from cheftako/GetClusters
Automatic merge from submit-queue (batch tested with PRs 67736, 68123, 68138). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Added support to get clusters in gce cloud provider.

**What this PR does / why we need it**:
Implemented the call to get all cluster objects in a zone for a project.
Also added code to allow the container api to be set in the gce.conf
file.

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:

**Release note**:
```release-note
NONE
```
2018-09-04 12:51:32 -07:00
Davanum Srinivas
ae0dde5c7d
Remove e2e-image-puller
A long time ago, We added the image prepulling as a workaround due to
the overwhelming amount of flake caused by pulling during the tests.
This functionality has been broken for a while now when we switched to a
COS image where mounting `docker` binary into `busybox` stopped working.
So we just have dead code we should clean up.

Change-Id: I538171a5c1d9361eee7f9e0a99655b88b1721e3e
2018-09-03 20:43:54 -04:00
Kubernetes Submit Queue
c2c393d879
Merge pull request #67743 from Random-Liu/kube-addon-extra-prune
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Support extra prune resources in kube-addon-manager.

The default prune whitelist resources in https://github.com/kubernetes/kubernetes/blob/master/pkg/kubectl/cmd/apply.go#L531 are sometimes not enough.

One example is that when we remove an admission webhook running as an addon pod, after we remove the addon yaml file, the admission webhook pod will be pruned, but the `MutatingWebhookConfiguration`/`ValidationWebhookConfiguration` won't... If the webhook failure policy is `Fail`, this will break the cluster, and users can't create new pods anymore.

It would be good to at least make this configurable, so that users and vendors can configure it based on their requirement.

This PR keeps the default prune resource list exactly the same with before, just makes it possible to add extra ones.

@dchen1107 @MrHohn @kubernetes/sig-cluster-lifecycle-pr-reviews  @kubernetes/sig-gcp-pr-reviews 

Signed-off-by: Lantao Liu <lantaol@google.com>

**Release note**:
```release-note
Support extra `--prune-whitelist` resources in kube-addon-manager.
```
2018-08-31 21:56:12 -07:00
Lantao Liu
6a880b2567 Support extra prune resources in kube-addon-manager.
Signed-off-by: Lantao Liu <lantaol@google.com>
2018-08-31 18:43:48 -07:00
Kubernetes Submit Queue
2d7b92ee74
Merge pull request #68100 from vishh/add-node-termination-handle
Automatic merge from submit-queue (batch tested with PRs 64283, 67910, 67803, 68100). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Adding GCE node termination handler as an optional addon. 

This step is a pre-requisite for auto-deploying that addon in GKE

cc @mikedanese
2018-08-31 16:46:45 -07:00
Tim Allclair
a58008ee42 Register RuntimeClass CRD as an addon 2018-08-31 16:09:57 -07:00
Vishnu kannan
ee65e6ac04 Adding GCE node termination handler as an optional addon.
This step is a pre-requisite for auto-deploying that addon in GKE.

Signed-off-by: Vishnu kannan <vishnuk@google.com>
2018-08-31 12:47:37 -07:00
Kubernetes Submit Queue
eff30a31a7
Merge pull request #68120 from wojtek-t/configurable_etcd_servers
Automatic merge from submit-queue (batch tested with PRs 67756, 64149, 68076, 68131, 68120). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Allow for configuring etcd servers addresses in gce
2018-08-31 09:06:42 -07:00
wojtekt
122b7a5f82 Allow for configuring etcd servers 2018-08-31 12:37:13 +02:00
Kubernetes Submit Queue
58ead1c1e8
Merge pull request #65862 from loburm/remove_basic_audit
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Promote AdvancedAuditing to GA

**What this PR does / why we need it**:
Removes deprecated legacy code used for basic audit logging in favor of advanced audit logging.

```release-note
Promote AdvancedAuditing to GA, replacing the previous (legacy) audit logging mechanisms.
```
2018-08-30 07:31:23 -07:00
Kubernetes Submit Queue
7c2a9a0150
Merge pull request #67943 from Szetty/master
Automatic merge from submit-queue (batch tested with PRs 67745, 67432, 67569, 67825, 67943). If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Add flag for disabling prometheus-to-sd only for daemon sets

```release-note
NONE
```
2018-08-29 15:19:45 -07:00
Arnold Szederjesi
134f7f2a9d Add flag for disabling prometheus-to-sd only for daemon sets 2018-08-28 14:09:07 +02:00
Laszlo Janosi
a6da2b1472 K8s SCTP support implementation for the first pull request
The requested Service Protocol is checked against the supported protocols of GCE Internal LB. The supported protocols are TCP and UDP.

SCTP is not supported by OpenStack LBaaS. If SCTP is requested in a Service with type=LoadBalancer, the request is rejected. Comment style is also corrected.

SCTP is not allowed for LoadBalancer Service and for HostPort. Kube-proxy can be configured not to start listening on the host port for SCTP: see the new SCTPUserSpaceNode parameter

changed the vendor github.com/nokia/sctp to github.com/ishidawataru/sctp. I.e. from now on we use the upstream version.

netexec.go compilation fixed. Various test cases fixed

SCTP related conformance tests removed. Netexec's pod definition and Dockerfile are updated to expose the new SCTP port(8082)

SCTP related e2e test cases are removed as the e2e test systems do not support SCTP

sctp related firewall config is removed from cluster/gce/util.sh. Variable name sctp_addr is corrected to sctpAddr in pkg/proxy/ipvs/proxier.go

cluster/gce/util.sh is copied from master
2018-08-27 05:56:27 +00:00
Walter Fender
c0b7c42461 Added support to get clusters in gce cloud provider.
Implemented the call to get all cluster objects in a zone for a project.
Also added code to allow the container api to be set in the gce.conf
file.
Requested fix for @lavalamp. Fixed GetClusters to be GetManagedClusters.
Leaving ListClusters as ListClusters as it is part of the Cloud Clusters
interface, despite also being a "managed" call.
Remove copy pasta :D
Fixed method variable name.
2018-08-24 13:41:45 -07:00
Kubernetes Submit Queue
d67a03183a
Merge pull request #67687 from Lion-Wei/remote-reschrduler
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

remove rescheduler since scheduling DS pods by default scheduler is moving to beta

**What this PR does / why we need it**:

remove rescheduler since scheduling DS pods by default scheduler is moving to beta

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #64725

**Special notes for your reviewer**:

**Release note**:
```release-note
Remove rescheduler since scheduling DS pods by default scheduler is moving to beta.
```
2018-08-23 12:32:17 -07:00
Marian Lobur
3f730d4c25 Remove deprecated legacy audit logging code. 2018-08-23 12:08:54 +02:00
Daniel Kłobuszewski
c4434855a6 Set --audit-webhook-mode flag properly based on the env variable 2018-08-22 15:25:26 +02:00
liangwei
5ea138f4e9 remove rescheduler 2018-08-22 11:49:14 +08:00
Kubernetes Submit Queue
f6817d2f6d
Merge pull request #67504 from loburm/adjust_resources
Automatic merge from submit-queue (batch tested with PRs 67062, 67169, 67539, 67504, 66876). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Decrease CPU requests of master components in two times.

**What this PR does / why we need it**:
Decreases cpu request of each master component by two. This allows to schedule more components on the master node in case of one-core machines. At the same time it doesn't change current cpu share that each component receives (https://kubernetes.io/docs/concepts/configuration/manage-compute-resources-container/#how-pods-with-resource-limits-are-run).

```release-note
NONE
```
2018-08-17 11:58:18 -07:00
Karol Wychowaniec
d5b32d8830 Fix parameter for fluentd-gcp-scaler 2018-08-16 16:18:51 +02:00
Marian Lobur
aaedbb52d3 Decrease CPU requests of master components in two times. 2018-08-16 15:50:53 +02:00
Kubernetes Submit Queue
803e96eb28
Merge pull request #66185 from vantuvt/vantuvt-patch-3
Automatic merge from submit-queue (batch tested with PRs 66177, 66185, 67136, 67157, 65065). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Update configure-helper.sh to support heapster resource optimizations

**What this PR does / why we need it**:

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2018-08-15 02:09:08 -07:00
Kubernetes Submit Queue
cef8e585c1
Merge pull request #66177 from vantuvt/vantuvt-patch-2
Automatic merge from submit-queue (batch tested with PRs 66177, 66185, 67136, 67157, 65065). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Templatize the scaling policy for metrics-server

**What this PR does / why we need it**:

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2018-08-15 02:09:04 -07:00
Van Tu
3f33cb7cd5 Populate final scaling policy values for system addon optimizations 2018-08-10 10:21:07 -04:00
Van Tu
5d191d877a Populate final scaling policy values for system addon optimizations 2018-08-10 10:14:28 -04:00
Chao Wang
08fbf701db use v1 version of advanced audit policy in gce shell 2018-08-09 10:08:19 +08:00
Van Tu
5e6a884dc6 Revise the setting of variables to leverage environment variables. 2018-08-08 13:59:34 -04:00
Bryan Moyles
32c2bfadfd A large set of improvements to the Stackdriver components.
Metadata Agent Improvements
Bump metadata agent version to 0.2-0.0.21-1.
Expand the metadata agent's access to all API groups.
Remove metadata agent config maps in favor of command line flags.
Update the metadata agent's liveness probe to a new /healthz handler.

Logging Agent Improvements
Bump logging agent version to 0.2-1.5.33-1-k8s-1.
Appropriately set log severity for k8s_container.
Fix detect exceptions plugin to analyze message field instead of log field.
Fix detect exceptions plugin to analyze streams based on local resource id.
Disable the metadata agent for monitored resource construction in logging.
Disable timestamp adjustment in logs to optimize performance.
Reduce logging agent buffer chunk limit to 512k to optimize performance.
2018-08-06 11:26:35 -04:00