Commit Graph

402 Commits

Author SHA1 Message Date
Matt Matejczyk
97e5dd489a Add envs for configuring hollow-node resource usage.
In addition clean up template variables to always use lower case in
hollow-node_template.yaml.
2019-11-08 12:50:40 +01:00
Kubernetes Prow Robot
7a1eaa112e
Merge pull request #84696 from dims/BenTheElder-byebyehacke2e
Remove hack/e2e.go
2019-11-07 09:05:04 -08:00
Kubernetes Prow Robot
9d708b0203
Merge pull request #84858 from oxddr/revert-kubemark
Revert "enabling fluentd on kubemark"
2019-11-06 12:21:22 -08:00
Kubernetes Prow Robot
6ca4854ddf
Merge pull request #84774 from mm4tt/kubemark_owners
Add sig-scalability-approvers/reviewers as kubemark approvers/reviewers
2019-11-06 12:20:22 -08:00
Janek Łukaszewicz
47c66f9f08 Revert "enabling fluentd on kubemark"
This reverts commit 92f56ab692.

This has broken kubemark test. Let's revert this change, debug offline and fix.
2019-11-06 11:59:41 +01:00
Matt Matejczyk
14e731924a Add sig-scalability-approvers/reviewers as kubemark approvers/reviewers 2019-11-06 08:51:49 +01:00
Kubernetes Prow Robot
8ff16f35f8
Merge pull request #84007 from wojtek-t/reduce_node_update_frequency
Reduce node update frequency
2019-11-04 15:28:43 -08:00
Kubernetes Prow Robot
46e286edcc
Merge pull request #83897 from krzysied/kubemark_enable_logging
Enabling fluentd on kubemark
2019-11-04 13:44:11 -08:00
Benjamin Elder
83c56a0373
remove hack/e2e.go 2019-11-03 19:36:59 -05:00
wojtekt
12c8b4a9df Bumpd NodeProblemDetector 2019-11-03 08:50:22 +01:00
Krzysztof Siedlecki
92f56ab692 enabling fluentd on kubemark 2019-10-14 14:48:48 +02:00
Kubernetes Prow Robot
833e8dc10b
Merge pull request #83736 from krzysied/kubemark_node_labels
Kubemark node labels
2019-10-11 05:17:47 -07:00
Krzysztof Siedlecki
8f9d9961a2 fixing sed separator 2019-10-11 10:54:01 +02:00
Timothy St. Clair
97055841b1 Audit of test/* OWNERS files 2019-10-10 15:52:51 -05:00
draveness
495faa22db feat: cleanup pod critical pod annotations feature 2019-08-09 08:41:23 +08:00
Maciej Borsz
e442a427f5 Update kube-addon-manager to v9.0.2. 2019-08-01 16:15:51 +02:00
mlmhl
8ca6de6d20 fix kubemark e2e test script 2019-07-23 10:07:14 +08:00
draveness
d83526d253 Revert "feat: cleanup pod critical pod annotations feature"
This reverts commit b6d41ee5cc.
2019-07-18 13:31:12 +08:00
Kubernetes Prow Robot
642a06e552
Merge pull request #79554 from draveness/feature/remove-critical-pod-annotation
feat: cleanup pod critical pod annotations feature
2019-07-11 22:03:04 -07:00
Maciej Borsz
bf5424bbbf Add support for HA kubemark 2019-07-11 11:56:36 +02:00
Maciej Borsz
bb47330bd7 Remove support for KUBEMARK_MASTER_COMPONENTS_QPS_LIMITS 2019-07-11 08:28:01 +02:00
draveness
b6d41ee5cc feat: cleanup pod critical pod annotations feature 2019-07-11 08:54:19 +08:00
Maciej Borsz
4646594f29 Migrate kubemark to e2e-up/e2e/down scripts. 2019-07-10 11:23:55 +02:00
chaowang
9ba0d47465
Remove deprecated Kubelet security controls
Change-Id: I9f770e6780b60e881092690f6f177d726f474fe3
2019-05-16 13:33:52 -04:00
Yuwen Ma
1f0f050fde Update etcd* version to use latest released images. 2019-05-13 17:28:40 -07:00
Kubernetes Prow Robot
6027a38e78
Merge pull request #77282 from MrHohn/addon-manager-9.0.1
Bump addon-manager to v9.0.1
2019-05-06 14:01:52 -07:00
Mark Wolters
1456979e93 Added function to create kubeconfig for addon-manager 2019-05-03 15:12:16 -07:00
Zihong Zheng
037d4b3a07 Bump addon-manager to v9.0.1
- Rebase image on debian-base:v1.0.0.
2019-04-30 15:19:08 -07:00
Wei Huang
fbec01dc71
kubemark: fix and enhance kubemark scripts for IKS
- fix shell script issues
  - `bx` is deprecated; rename to `ibmcloud`
  - remove unnecessay variable replacement in hollow-node_template.yaml
  - add replacement logic for HOLLOW_KUBELET_TEST_ARGS and HOLLOW_PROXY_TEST_ARGS
  - don't hardcode KUBEMARK_IMAGE_REGISTRY to brandondr96
- make cluster number and spec configurable
  - make number and spec of workers configurable
  - separate NUM_NODES and KUBEMARK_NUM_NODES
2019-04-26 10:15:29 -07:00
Matt Matejczyk
02f282187b Create the "internal" firewall rule for kubemark master.
This is equivalent to the "internal" firewall rule that is created for
the regular masters.
The main reason for doing it is to allow prometheus scraping metrics
from various kubemark master components, e.g. kubelet.

Ref. https://github.com/kubernetes/perf-tests/issues/503
2019-04-18 17:25:27 +02:00
Mateusz Matejczyk
17daab3a7d Fail on master or hollow nodes set-up error.
Ref. https://github.com/kubernetes/kubernetes/issues/76490
2019-04-12 12:17:20 +02:00
wojtekt
2c36a2ec1a Add TLS support to kubemark 2019-04-03 08:29:42 +02:00
Bob Killen
e137f4702a
Fix shellcheck lint errors in test/kubemark/stop-kubemark.sh 2019-02-25 15:21:32 -05:00
Bob Killen
b8aae458a1
Fix shellcheck lint errors in test/kubemark/start-kubemark.sh 2019-02-25 15:21:31 -05:00
Bob Killen
46333a01b4
Fix shellcheck lint errors in test/kubemark/run-e2e-tests.sh 2019-02-25 15:21:31 -05:00
Bob Killen
adf4bf1741
Fix shellcheck lint errors in test/kubemark/resources/start-kubemark-master.sh 2019-02-25 15:21:31 -05:00
Bob Killen
f72ac1f5b7
Fix shellcheck lint errors in test/kubemark/master-log-dump.sh 2019-02-25 15:21:31 -05:00
Bob Killen
cb59cb33ff
Fix shellcheck lint errors in test/kubemark/iks/util.sh 2019-02-25 15:21:30 -05:00
Bob Killen
e3e2a96521
Fix shellcheck lint errors in test/kubemark/iks/startup.sh 2019-02-25 15:21:30 -05:00
Bob Killen
6310305d3b
Fix shellcheck lint errors in test/kubemark/iks/shutdown.sh 2019-02-25 15:21:30 -05:00
Bob Killen
186b83fe5b
Fix shellcheck lint errors in test/kubemark/gce/util.sh 2019-02-25 15:21:30 -05:00
Bob Killen
5f4b919887
Fix shellcheck lint errors in test/kubemark/common/util.sh 2019-02-25 15:21:29 -05:00
Bob Killen
b538f18c0e
Add color-coding to kubemark scripts. 2019-02-25 14:53:40 -05:00
Xiang Dai
36065c6dd7 delete all duplicate empty blanks
Signed-off-by: Xiang Dai <764524258@qq.com>
2019-02-23 10:28:04 +08:00
xichengliudui
641f883b82 fix shellcheck in test/integration/... and test/kubemark/... 2019-02-18 01:16:39 -05:00
Roy Lenferink
b43c04452f Updated OWNERS files to include link to docs 2019-02-04 22:33:12 +01:00
Kubernetes Prow Robot
d306d68a36
Merge pull request #72978 from liggitt/addon-changelog
Update addon-manager changelog/image
2019-01-24 16:30:00 -08:00
Matt Brannock
d8f10dcac5 Append kubemark apiserver args after defaults
This allows for overriding defaults (e.g. max requests inflight) in
prow job configs by using KUBEMARK_APISERVER_TEST_ARGS. These are
passed to the start-kubemark-master.sh script as APISERVER_TEST_ARGS.
2019-01-16 13:42:51 -08:00
Jordan Liggitt
df97217f7f Update addon-manager changelog/image 2019-01-16 13:26:39 -05:00
Jordan Liggitt
b409ffa658 Update test manifests to apps/v1 2018-12-19 11:19:12 -05:00
wojtekt
fc346b2086 Allow for configuring etcd servers addresses in kubemark 2018-12-13 11:50:49 +01:00
Joe Betz
862b945e5a Update default etcd server to 3.3.10 for kubernetes 1.13 2018-12-03 11:03:49 -08:00
Jeff Grafton
7b93b50e40 Update to use kube-addon-manager:v8.9 2018-10-24 16:19:51 -07:00
k8s-ci-robot
dbd3be9213
Merge pull request #67695 from ipuustin/start-kubemark
start-kubemark.sh: clean up the shell script.
2018-10-16 10:03:04 -07:00
Zihong Zheng
81eae648cb Bump addon-manager to v8.8
- Rebase docker image on debian-base:0.3.2.
2018-10-02 11:43:40 -07:00
Jeff Grafton
3388e0ce5f Update to use etcd:3.2.24-1 image 2018-09-20 12:40:26 -07:00
Kubernetes Submit Queue
361746266a
Merge pull request #68318 from timothysc/etcd-3-2-24
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Update default etcd server to 3.2.24 for kubernetes 1.12

**What this PR does / why we need it**:
Update default etcd server to 3.2.24 for kubernetes 1.12

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
xref #68147 

**Special notes for your reviewer**:
NONE

**Release note**:

```
Update default etcd server to 3.2.24 for kubernetes 1.12
```

/assign @wojtek-t @jpbetz @dims 
/cc @kubernetes/sig-cluster-lifecycle-pr-reviews @gyuho
2018-09-07 04:42:11 -07:00
Timothy St. Clair
ad2ed0e7df Update default etcd server to 3.2.24 for kubernetes 1.12
Signed-off-by: Timothy St. Clair <timothysc@gmail.com>
2018-09-06 10:24:57 -05:00
Zihong Zheng
e9127b0dba Bump addon-manager to v8.7
- Support extra `--prune-whitelist` resources in kube-addon-manager.
- Update kubectl to v1.10.7.
2018-09-05 11:01:01 -07:00
Shyam Jeedigunta
63ce112d9e GC kubemark image after cluster starts up 2018-08-31 18:56:36 +02:00
Shyam Jeedigunta
be20deaf96 Parallelize kubemark cluster creation 2018-08-23 18:33:38 +02:00
Ismo Puustinen
d4365e056f start-kubemark.sh: clean up the shell script.
Do some cleanups to start-kubemark.sh.

1. Add double quotes around variables which are expanded. This is done
   even on those variables which probably won't have spaces, globs or
   similar (such as $MASTER_IP) to stay consistent.

2. In one place, change old-type `...` subshell invocation to $(...) to
   stay consistent through the file.

3. Remove useless echo commands in expressions: FOO=$(echo "$bar")
   becomes FOO="$bar".

4. In a few places, remove double quotes around variables when an
   expression is already inside them: the variables would have been
   effectively unquoted.

The last change in the patch changes the printing a bit -- the old way
did not print whitespace correctly due to inner echo missing the quotes
around it. The change should fix the printout:

-      echo $(echo "${pods}" | grep -v "Running")
+      echo "${pods}" | grep -v Running
2018-08-22 11:57:57 +03:00
Kubernetes Submit Queue
7749eeaf3f
Merge pull request #67660 from vikaschoudhary16/fsnotify-limits
Automatic merge from submit-queue (batch tested with PRs 65788, 67648, 67660). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Increase inotify max_user_instance limit from 200 to 1000

Fixes:https://github.com/kubernetes/kubernetes/issues/64614
Related:https://github.com/kubernetes/kubernetes/issues/41713

Tested on local GCP cluster with 1000, it works.


**Release note**:

```release-note
None
```

/cc @kubernetes/sig-scalability-misc @wojtek-t @gmarek @Random-Liu @shyamjvs @jiayingz @saad-ali @RenaudWasTaken @figo
2018-08-21 10:14:04 -07:00
Kubernetes Submit Queue
b666113f17
Merge pull request #67173 from charrywanganthony/auditv1beta1Tov1_kubemark
Automatic merge from submit-queue (batch tested with PRs 67332, 66737, 67281, 67173). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

use v1 version of advanced audit policy in kubemark

audit api version has been updated to v1 #65891 

**Release note**:
```release-note
NONE
```
2018-08-21 05:25:14 -07:00
vikaschoudhary16
98c9adf7fe Increase inotify user instance limit 2018-08-21 08:11:26 -04:00
Kubernetes Submit Queue
31420467ae
Merge pull request #67302 from dixudx/dnsmasq_add_loop_detect
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

add --dns-loop-detect option to dnsmasq run by kube-dns

**What this PR does / why we need it**:

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #67299

**Special notes for your reviewer**:
/cc @kubernetes/sig-network-pr-reviews 

**Release note**:

```release-note
add --dns-loop-detect option to dnsmasq run by kube-dns
```
2018-08-18 08:47:18 -07:00
Maciej Borsz
30fb87daf8 Kubemark: don't recreate hollow node on VM reboot. 2018-08-16 10:45:32 +02:00
Di Xu
25f9909cba add --dns-loop-detect option to dnsmasq run by kube-dns 2018-08-11 22:30:25 +08:00
Chao Wang
c4662e98b2 use v1 version of advanced audit policy in kubemark 2018-08-09 10:03:21 +08:00
Brandon Dalla Rosa
1fb6e3a5cc Added check for namespace file 2018-07-31 14:08:04 -04:00
Brandon Dalla Rosa
510f6b8916 Adding IKS functionality to kubemark 2018-07-23 11:42:22 -04:00
Shyam Jeedigunta
0d5c430606 Create WORKSPACE file before running bazel in kubemark 2018-07-09 23:07:03 +02:00
wojtekt
26b3bacb65 Make proxier params configurable in kubemark 2018-07-06 16:07:15 +02:00
Shyam Jeedigunta
69090f0ad2 Make docker authentication in kubemark provider-independent 2018-07-05 11:01:22 +02:00
Shyam Jeedigunta
e1bdc784a0 Unify bazel and makefile modes of build for kubemark 2018-07-05 11:01:17 +02:00
Kubernetes Submit Queue
7496c64b46
Merge pull request #65593 from bsalamat/priority_admission
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Limit usage of system critical priority classes to the system namespace

**What this PR does / why we need it**:
Changes Priority admission controller to limit usage of system critical priority classes to the system namespace. This change is needed to mitigate the risk of creating many pods at system critical priority levels that could cause preemption of system critical components.

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

ref/ #65557

**Special notes for your reviewer**:

**Release note**:

```release-note
Limit the usage of system-node-critical and system-cluster-critical priority classes to kube-system namespace.
```

/sig scheduling
2018-07-02 01:09:06 -07:00
Bobby (Babak) Salamat
0daedee0de Change our tests to ensure that critical system pods are created in the system namespace 2018-06-28 22:25:27 -07:00
xuzhonghu
cfcd0e4d45 stop using deprecated --etcd-quorum-read 2018-06-09 12:38:46 +08:00
Matthias Bertschy
9b15af19b2 Update all script to use /usr/bin/env bash in shebang 2018-04-19 13:20:13 +02:00
Kubernetes Submit Queue
3ed4355f43
Merge pull request #62660 from krzysied/kubemark_dns
Automatic merge from submit-queue (batch tested with PRs 62436, 62499, 62664, 62685, 62660). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Adding kube dns to kubemark

Adding kube dns to the kubemark. It will allow to test dns impact on kuberneters master performance.
Kube dns is optional - requires ENABLE_KUBEMARK_KUBE_DNS set to "true".

```release-note
NONE
```
2018-04-17 17:31:23 -07:00
Krzysztof Siedlecki
bbb1d45d9a Adding kube dns to kubemark 2018-04-17 15:47:51 +02:00
Kubernetes Submit Queue
256ce8393f
Merge pull request #62650 from wojtek-t/bump_inflight_limits
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Increase max requests inflight limits in gce for very large clusters
2018-04-16 13:48:09 -07:00
wojtekt
1bcdfdbe00 Increase max requests inflight limits in gce for very large clusters 2018-04-16 20:46:41 +02:00
Kubernetes Submit Queue
c47b147f47
Merge pull request #62539 from krzysied/kubemark_img_repo_fix
Automatic merge from submit-queue (batch tested with PRs 62407, 62602, 62539, 62639, 62647). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Fix kubemark image-registry name assignment

Allows to create kubemark instance without explicitly specifying the project name.
start-kubemark.sh used to not run properly when using project name acquired from the cloud provider.

```release-note
NONE
```
2018-04-16 08:55:15 -07:00
Krzysztof Siedlecki
afc3befac2 Fixing FULL_REGISTRY assignment 2018-04-13 16:49:08 +02:00
Joe Betz
a795cb61bc Bump etcd default server version to 3.2.18 2018-04-11 21:12:44 -07:00
Joe Betz
dc4d92e154 Reimplement migrate-if-needed.sh in go 2018-04-10 09:19:30 -07:00
Joe Betz
e2a25f9b54 Bump to etcd 3.1.12 to pick up critical fix 2018-03-09 14:28:23 -08:00
Shyam Jeedigunta
21f5e69f08 Rollback etcd server version to 3.1.11 due to #60589 2018-03-08 13:07:15 +01:00
Sen Lu
b01d2ba048 purge all the -v references from e2e.go 2018-03-06 20:36:06 -08:00
Joe Betz
04c6d0ab26 Bump etcd server patch version to 3.2.16 2018-03-05 13:58:51 -08:00
Mike Danese
c0b7364563 remove gcloud docker -- since it's deprecated 2018-02-28 00:24:27 -08:00
Zihong Zheng
677f740adf Bump addon-manager to v8.6 2018-02-20 11:27:14 -08:00
Shyam Jeedigunta
76c1828c1c
Mark kubemark images w/ random tags to avoid race b/w runs 2018-02-08 17:54:01 +01:00
Shyam Jeedigunta
f3cc62d870
Unify image registry value in kubemark setup scripts 2018-02-08 17:53:49 +01:00
Tim Hockin
3586986416 Switch to k8s.gcr.io vanity domain
This is the 2nd attempt.  The previous was reverted while we figured out
the regional mirrors (oops).

New plan: k8s.gcr.io is a read-only facade that auto-detects your source
region (us, eu, or asia for now) and pulls from the closest.  To publish
an image, push k8s-staging.gcr.io and it will be synced to the regionals
automatically (similar to today).  For now the staging is an alias to
gcr.io/google_containers (the legacy URL).

When we move off of google-owned projects (working on it), then we just
do a one-time sync, and change the google-internal config, and nobody
outside should notice.

We can, in parallel, change the auto-sync into a manual sync - send a PR
to "promote" something from staging, and a bot activates it.  Nice and
visible, easy to keep track of.
2018-02-07 21:14:19 -08:00
Joe Betz
f0d04b7131 Update etcd server version to 3.2.13 2018-02-02 17:25:13 -08:00
Shyam Jeedigunta
87af748493 Expose etcd compaction interval param for kubemark apiserver 2018-02-01 11:10:02 +01:00
Mike Danese
e12b7b8936 bump version of addon manager 2018-01-24 09:31:18 -08:00
Tim Hockin
e9dd8a68f6 Revert k8s.gcr.io vanity domain
This reverts commit eba5b6092a.

Fixes https://github.com/kubernetes/kubernetes/issues/57526
2017-12-22 14:36:16 -08:00