Commit Graph

153 Commits

Author SHA1 Message Date
Hongchao Deng
39e5a56691 etcd: update version to 3.1.10 2017-10-02 12:27:46 -07:00
Shyam Jeedigunta
eadce7a180 Add audit-logging, feature-gates & few admission plugins to kubemark 2017-10-02 12:13:52 +02:00
Walter Fender
d8c8b8d65b Enabling aggregator functionality on kubemark, gce
Enabling full functionality aggregator functionality in kubemark tests.
This includes configuring it to work in gce (we seem to assume gce in our kubemark tests)
It also includes setting up the relevant security and auth config.
Removing unneeded reference to CA key for MHBauer.
Fixed to pull the "parsed" values for the certs.
Fix from shyamjvs.
2017-09-05 13:01:05 -07:00
Shyam Jeedigunta
1f6809b746 Only list hollow-node pods while trying to count them 2017-08-30 14:02:33 +02:00
Shyam JVS
f81d9ed9b9 Reduce hollow proxy mem/node 2017-07-21 03:57:03 +02:00
Shyam Jeedigunta
b655953e21 Enable DefaultTolerationSeconds and PodPreset admission plugins for kubemark 2017-06-04 19:52:57 +02:00
Clayton Coleman
4ce3907639
Add Initializers to all admission control paths by default 2017-06-02 22:09:04 -04:00
Shyam Jeedigunta
02092312bb Make kubemark scripts fail fast 2017-05-30 11:59:13 +02:00
Shyam Jeedigunta
b72cbc074c chmod +x kubemark scripts 2017-05-26 22:03:12 +02:00
Kubernetes Submit Queue
c60bc53921 Merge pull request #46434 from shyamjvs/kubemark-config-upload
Automatic merge from submit-queue (batch tested with PRs 46124, 46434, 46089, 45589, 46045)

Copy kubeconfig to kubemark master

This should save the effort of digging through jenkins agent and its container to get the kubeconfig.
Ideally we should have kubectl directly working on the kubemark master, but I'm facing some issues due to older version of kubectl present by default on the node.

cc @wojtek-t @gmarek
2017-05-25 21:39:59 -07:00
Shyam Jeedigunta
8f2b4c3b33 Copy kubeconfig to kubemark master 2017-05-25 14:55:28 +02:00
gmarek
2437cf4d59 fix type in start-kubemark 2017-05-25 11:48:01 +02:00
gmarek
27fc7be396 Make CPU request for heapster in kubemark scale with the number of Nodes 2017-05-22 16:20:27 +02:00
Shyam Jeedigunta
804a4f558c Make usage of real proxier in hollow-proxy optional (default=true) 2017-05-18 14:30:12 +02:00
Dan Williams
b3705b6e35 hack/cluster: consolidate cluster/ utils to hack/lib/util.sh
Per Clayton's suggestion, move stuff from cluster/lib/util.sh to
hack/lib/util.sh.  Also consolidate ensure-temp-dir and use the
hack/lib/util.sh implementation rather than cluster/common.sh.
2017-03-30 22:34:46 -05:00
Kubernetes Submit Queue
db5e85af5f Merge pull request #41980 from shyamjvs/one-more-time
Automatic merge from submit-queue (batch tested with PRs 41980, 42192, 42223, 41822, 42048)

Modified kubemark startup scripts to restore master on reboot

Fixes #41735 

As discussed in the issue, modified the scripts to satisfy the conditions of restoring master env, running non-idempotent operations only for the first time and persist important data like pki/auth files on a PD.
Also attached `start-kubemark-master.sh` as startup-script metadata to master instance (on GCE) so that it is called automatically on each boot.

cc @kubernetes/sig-scalability-misc @wojtek-t @gmarek
2017-03-02 00:59:13 -08:00
Shyam JVS
ab78b20bc1 Make kubemark hollow node logging verbosity configurable 2017-03-01 20:24:30 +01:00
Kubernetes Submit Queue
32d59cbb2f Merge pull request #42201 from shyamjvs/inotify-limit
Automatic merge from submit-queue (batch tested with PRs 42316, 41618, 42201, 42113, 42191)

[Kubemark] Add init container in hollow node for setting inotify limit of node to 200

Fixes #41713 

Along with adding the init container, I also changed the manifest to a yaml as otherwise the entire init container annotation would have to be in a single line (with escaped characters), as json doesn't allow multi-line strings.

cc @kubernetes/sig-scalability-misc @wojtek-t @gmarek @Random-Liu
2017-03-01 07:48:20 -08:00
Kubernetes Submit Queue
1a35155025 Merge pull request #41973 from wojtek-t/build_non_alpha_3_0_17_etcd_image
Automatic merge from submit-queue (batch tested with PRs 42162, 41973, 42015, 42115, 41923)

Release 3.0.17 etcd image
2017-02-28 22:05:59 -08:00
Shyam Jeedigunta
4574900634 Modified kubemark startup scripts to restore master on reboots 2017-02-28 19:51:00 +01:00
Shyam JVS
75e602ca28 Convert hollow-node manifest to yaml and add init container for setting inotify limit 2017-02-28 00:53:36 +01:00
Wojciech Tyczynski
74266e0dc0 Release 3.0.17 etcd image 2017-02-27 16:23:44 +01:00
Jordan Liggitt
34ac0dc302
Avoid fake node names in user info 2017-02-25 02:09:55 -05:00
Wojciech Tyczynski
b70e392161 Update clusters to use 3.0.17 etcd 2017-02-23 10:08:50 +01:00
Wojciech Tyczynski
6d303d3329 Increase cpu for kubeproxy in kubemark in large clusters 2017-02-22 08:44:34 +01:00
Wojciech Tyczynski
4426156aa6 More resources for hollowproxy in large kubemarks 2017-02-20 09:26:17 +01:00
Shyam Jeedigunta
3ac0e22f62 Refactored kubemark code into provider-specific and provider-independent parts [Part-3] 2017-02-08 17:03:13 +01:00
Shyam Jeedigunta
dd133769de Refactored kubemark code into provider-specific and provider-independent parts [Part-2] 2017-01-31 13:55:57 +01:00
Shyam Jeedigunta
c62e5214c3 Refactored kubemark code into provider-specific and provider-independent parts [Part-1] 2017-01-26 22:54:14 +01:00
Wojciech Tyczynski
fbd5c7c380 Revert "Refactored kubemark into cloud-provider independent code and GCE specific code" 2017-01-24 10:42:17 +01:00
Shyam Jeedigunta
d2fadbe30f Refactored kubemark code into provider-specific and provider-independent parts 2017-01-19 15:34:13 +01:00
Shyam Jeedigunta
cc78a3f428 Passing correct master address to kubemark NPD & authenticating+authorizing it with apiserver 2017-01-18 18:23:23 +01:00
Shyam Jeedigunta
9b0d8b9747 Added RBAC for heapster in kubemark 2017-01-18 13:47:08 +01:00
Shyam Jeedigunta
491c26feca Fix RBAC role for kube-proxy in Kubemark 2017-01-17 11:39:00 +01:00
Shyam Jeedigunta
312e2f85a6 run-gcloud-compute-with-retries in kubemark handles resource already exists case 2017-01-06 23:21:15 +01:00
Kubernetes Submit Queue
85ad3045be Merge pull request #39349 from shyamjvs/rbac-for-kubemark
Automatic merge from submit-queue

Updated kubemark with RBAC for controllers, proxy and kubelet

Fixes issue #39244 

@kubernetes/sig-scalability-misc @wojtek-t @gmarek
2017-01-06 13:42:54 -08:00
Shyam Jeedigunta
ce8c207328 Updated kubemark with RBAC for controller-manager, kubecfg, kubelet and proxy 2017-01-06 08:54:54 +01:00
Kubernetes Submit Queue
f4a8713088 Merge pull request #36229 from wojtek-t/bump_etcd_version
Automatic merge from submit-queue (batch tested with PRs 36229, 39450)

Bump etcd to 3.0.14 and switch to v3 API in etcd.

Ref #20504

**Release note**:

```release-note
Switch default etcd version to 3.0.14.
Switch default storage backend flag in apiserver to `etcd3` mode.
```
2017-01-04 17:36:06 -08:00
Shyam Jeedigunta
7e12fd4bfd Added 'hollow'-node-problem-detector to hollow-nodes in kubemark 2016-12-20 12:04:24 +01:00
Wojciech Tyczynski
76f115a8ee Bump etcd to 3.0.14 2016-12-20 11:57:45 +01:00
Shyam Jeedigunta
9051462497 Migrated kubemark master to GCI from Debian. 2016-12-19 13:51:56 +01:00
gmarek
40907930a3 Fix the kubemark fix 2016-12-15 10:26:39 +01:00
Shyam Jeedigunta
10b39d9dd7 Fixed kubemark to work when ETCD_X flags are set 2016-12-14 18:13:31 +01:00
Shyam Jeedigunta
f7ce6a7d10 On kubemark master, kubelet now runs as a supervisord process and all master components as pods 2016-12-12 13:56:07 +01:00
Shyam Jeedigunta
06ce9ae479 Moved start-kubemark-master.sh from test/kubemark/ to test/kubemark/resources/ 2016-12-07 18:15:24 +01:00
Hongchao Deng
f9bc3ac419 kubemark: minor fix start-kubemark.sh 2016-11-22 18:00:23 -08:00
gmarek
4356cb633d Revert "Merge pull request #36065 from kubernetes/revert-35918-supervisor"
This reverts commit a4ee3ed026, reversing
changes made to 8c90bc35e2.
2016-11-22 09:46:48 +01:00
Wojciech Tyczynski
9ccddb9b7d Revert "Add log rotation to kubemark" 2016-11-21 14:55:52 +01:00
gmarek
87f87206bc Pass GCLOUD_COMMON_ARGS do disk attach in Kubemark 2016-11-21 09:04:04 +01:00
Wojciech Tyczynski
a96dd63367 Add log rotation to kubemark 2016-11-18 16:19:32 +01:00
gmarek
3fc177ff7c Allow storing events on a separate disk 2016-11-18 13:19:48 +01:00
gmarek
08d60999fc Allow passing custom list of admission plugins to kubemark 2016-11-17 12:32:41 +01:00
Wojciech Tyczynski
5ffda62588 Fix non-default etcd image handling in kubemark 2016-11-08 08:29:39 +01:00
Wojciech Tyczynski
314c4c2811 Revert "Make master components in kubemark monitored by supervisord" 2016-11-02 14:43:09 +01:00
gmarek
3e78f4feb8 Make master components in kubemark monitored by supervisord 2016-10-31 19:44:18 +01:00
Wojciech Tyczynski
7ee7b55c5e Rename TEST_ETCD_VERSION to ETCD_VERSION 2016-10-28 13:56:59 +02:00
gmarek
16d8e6400e Allow setting master root disk size in kubemark 2016-10-19 12:37:17 +02:00
Wojciech Tyczynski
3215e8535a Extend logging for kubemark failures debugging 2016-09-30 14:29:29 +02:00
Wojciech Tyczynski
8abf3c1600 Make it possible to set etcd version in kubemark 2016-09-27 13:13:29 +02:00
Jeff Grafton
13a3313957 Bundle kubemark in test tarball instead of server tarball 2016-09-26 11:06:48 -07:00
gmarek
c6ec8085f9 Extend kubemark cluster startup timeout to account for log route creation 2016-09-20 16:00:00 +02:00
Wojciech Tyczynski
086f7df09a Extend logging for debugging kubemark problems 2016-09-16 11:25:06 +02:00
Wojciech Tyczynski
52498e6050 Retry etcd starting in kubemark 2016-08-26 11:46:02 +02:00
Timothy St. Clair
a0d177ca71 Update core etcd references to use 3.0.4 2016-08-12 13:39:07 -05:00
gmarek
85f3bb271c Print location of kubemark kubeconfig at the end of start-kubemark 2016-08-10 13:50:19 +02:00
gmarek
8b17ec1447 fix kubemark 2016-08-10 12:42:47 +02:00
gmarek
ea26433a9c Debug kubemark startup problems 2016-08-10 11:58:22 +02:00
Kubernetes Submit Queue
012eb941d6 Merge pull request #28575 from fejta/check-resources
Automatic merge from submit-queue

Move kubemark, skew, upgrade, leak logic into hack/e2e.go

And move out of the `e2e_runner.sh`
Also make `start-kubemark.sh` automatically find `kubernetes-server-linux-amd64.tar.gz` instead of depending on a `RUN_FROM_DISTRO` env var

@gmarek can you review the kubemark-related changes?
@zmerlynn are you the right person to review upgrade changes?

@spxtr take a look at the overall `e2e.go` changes.

This is for https://github.com/kubernetes/kubernetes/issues/21843 and https://github.com/kubernetes/test-infra/pull/250

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/28575)
<!-- Reviewable:end -->
2016-08-09 15:54:50 -07:00
Erick Fejta
7011d8826e Move kubemark, skew, upgrade, leak logic into hack/e2e.go 2016-08-09 14:04:19 -07:00
Wojciech Tyczynski
2280737aa4 Set cache size in Kubemark 2016-08-09 13:34:13 +02:00
Hongchao Deng
74e6626967 Update etcd deprecated flag
- "-addr" => "--advertise-client-urls"
- "-bind-addr" => "--listen-client-urls"
2016-07-22 11:01:11 -07:00
Wojciech Tyczynski
28205d6a43 Fix Kubemark config after IP addresses machinations 2016-07-22 11:49:15 +02:00
Antoine Pelisse
ab3e4494d3 Tentatively fix broken kubemark tests
The multi-line bash command is ill-formed.
2016-07-21 20:39:04 -07:00
Filip Grzadkowski
a2c2f7d8f7 Add static IP address for kubemark master. 2016-07-21 21:03:18 +02:00
David McMahon
ef0c9f0c5b Remove "All rights reserved" from all the headers. 2016-06-29 17:47:36 -07:00
gmarek
5109776485 Add retries for make in start-kubemark 2016-05-30 16:51:30 +02:00
gmarek
cafbdba7d9 Change base64 -d flag to --decode flag to make it BSD compatible 2016-05-24 13:24:55 +02:00
Mike Danese
c2c030b6d8 fix kubemark 2016-05-20 15:42:40 -07:00
Wojciech Tyczynski
fe470b664b Pipe content-type variable to hollow node 2016-05-11 14:57:40 +02:00
gmarek
4a5ec11ce6 Pipe variables from kubemark config to master binaries 2016-05-11 11:22:03 +02:00
gmarek
b14809832b Add heapster to kubemark 2016-04-27 16:04:07 +02:00
gmarek
9120a60724 Kubemark uses kubectl from the repo 2016-03-31 09:13:42 -07:00
gmarek
0cf1b922c4 Add more logging in case of Kubemark startup failure 2016-02-18 16:32:04 +01:00
Wojciech Tyczynski
519021b978 Timeout creating kubemark nodes 2016-02-11 12:19:37 +01:00
gmarek
de740236b8 Randomize password to kubemark master 2016-02-02 15:36:08 +01:00
gmarek
35b317c094 Kubemark scripts retry failed gcloud commands 2016-02-01 21:05:57 +01:00
David Oppenheimer
913e6ce359 Revert "Kubemark scripts retry failed gcloud commands" 2016-01-29 13:07:01 -08:00
Marcin Wielgus
39428cc0e5 Kubemark scripts retry failed gcloud commands 2016-01-28 23:23:46 +01:00
Brad Erickson
53172a5356 Minion->Node rename: NUM_NODES 2015-11-25 00:45:10 -08:00
Hongchao Deng
1fde840aa8 kubemark: check if kubectl is installed in start script 2015-11-18 09:28:05 -08:00
gmarek
5a4e4d4d57 Add a HollowProxy to the HollowNode. 2015-10-27 18:23:29 +01:00
gmarek
3158741603 Run etcd for events on separate machine in Kubemark 2015-10-20 17:46:23 +02:00
gmarek
b88eb80a59 Prefix hollow-cluster-master name with instance prefix 2015-10-12 20:15:59 +02:00
gmarek
ea7f914394 Fix HollowNode template 2015-10-12 15:46:32 +02:00
gmarek
4dfd28086f Wait for all HollowNodes to become ready in start-kubemark.sh 2015-10-06 09:20:53 +02:00
gmarek
3137ecbf3b Create a firewall rule for kubemark master allowing connections on port 443 2015-10-02 14:36:31 +02:00
gmarek
1e7cdf95bd Add PROJECT to things added by SSL patch 2015-10-02 11:07:34 +02:00
gmarek
bc76b1616f Add SSL to communication in Kubemark 2015-10-02 10:39:24 +02:00
gmarek
b7954068a3 Add missing PROJECT flag to Kubemark scripts 2015-10-02 09:42:02 +02:00
gmarek
9a74980da2 Make kubemark work on Jenkins 2015-10-01 15:26:39 +02:00