Commit Graph

105 Commits

Author SHA1 Message Date
Masaki Kimura
701395c392 Remove dot import from e2e test and replace with framework.ExpectNoError 2019-06-14 20:46:11 +00:00
Jorge Alarcon Ochoa
4969a05327 Refactored pod-related functions from framework/util.go
This a refactoring of framework/utils.go into framework/pod.

Signed-off-by: Jorge Alarcon Ochoa <alarcj137@gmail.com>
2019-05-30 09:30:26 -04:00
Kenichi Omichi
48f1f74a51 Use ExpectNoError() for scalability and scheduling
The e2e test framework has ExpectNoError() for readable test code.
This replaces Expect(err).NotTo(HaveOccurred()) with it.
2019-05-15 20:19:25 +00:00
John Schnake
afc66a5487 Move scalability, upgrade, and common packages to framework/log
This is part of the transition to using framework/log instead
of the Logf inside the framework package. This will help with
import size/cycles when importing the framework or subpackages.
2019-05-04 12:45:15 -05:00
SataQiu
1405819049 fix golint failures of test/e2e/framework/framework.go 2019-04-08 15:11:37 +08:00
Kubernetes Prow Robot
79000d4ac5
Merge pull request #75783 from oomichi/golint-e2e-framework-m
Fix golint failures of e2e/framework/metrics_util.go
2019-04-05 11:51:21 -07:00
Kenichi Omichi
7af6ddd353 Fix golint failures of framework/metrics_util.go
This fixes golint failures of framework/metrics_util.go.

Cleanup:
- SaturationTime was only used in test/e2e/scalability/density.go.
  So this moves it into the e2e test.
- interestingClusterAutoscalerMetrics was not used in filterMetrics()
  so this removes the related code.
2019-04-02 16:25:16 +00:00
Andrew Sy Kim
4ac9feb7f9 test/e2e: replace legacy scheme with client-go scheme
Signed-off-by: Andrew Sy Kim <kiman@vmware.com>
2019-04-02 10:08:55 -04:00
Andrew Sy Kim
1470df7a05 remove usages of internal clientset in e2e framework
Signed-off-by: Andrew Sy Kim <kiman@vmware.com>
2019-03-28 21:13:40 -04:00
Chao Xu
1f2e2e61cf generated 2019-02-12 15:04:57 -08:00
Chao Xu
3f21ca029a changing imports 2019-02-12 10:06:04 -08:00
Roy Lenferink
b43c04452f Updated OWNERS files to include link to docs 2019-02-04 22:33:12 +01:00
Shyam Jeedigunta
6cd03ab8ae Fix TLS config in load test clients 2019-01-29 16:24:53 -08:00
Shyam Jeedigunta
d477bd904c Leave slack for addon pods in node's capacity 2019-01-22 20:26:02 -08:00
Maciej Borsz
25c2440996 Add node notready/unreachable tolerations to load/density pods. 2018-12-14 12:16:51 +01:00
wojtekt
68bae382b1 Fix density test 2018-11-14 10:17:40 +01:00
Mike Danese
7613482623 scale test service account token projection in kubemark 2018-10-26 09:57:56 -07:00
Chris O'Haver
402266afde add dns pod memory constraint 2018-10-18 10:35:30 -04:00
Guoliang Wang
c2622dd9d8 Replace Parallelize with function ParallelizeUntil and formally deprecate the Parallelize 2018-10-05 17:56:56 +08:00
Shyam Jeedigunta
bf81201b43 Remove deprecated [Feature:Empty] test 2018-09-12 12:56:19 +02:00
Kubernetes Submit Queue
b61bb1f554
Merge pull request #67764 from shyamjvs/add-etcd-db-size-measurement
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions here: https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md.

Add etcd DB size monitoring in density test

/cc @wojtek-t 

fyi - @jpbetz @gyuho @kubernetes/sig-scalability-misc 

```release-note
NONE
```
2018-08-30 09:49:43 -07:00
Shyam Jeedigunta
203664933d Add etcd DB size monitoring in density test 2018-08-30 14:40:59 +02:00
Shyam Jeedigunta
e062e6396b Revert "Re-calibrate load test throughputs"
This reverts commit 2f7f6deef7.
2018-08-28 13:27:38 +02:00
Kubernetes Submit Queue
a11dcecac0
Merge pull request #67776 from shyamjvs/fix-load-test-throughput
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Re-calibrate load test throughputs

/cc @wojtek-t 

```release-note
NONE
```
2018-08-24 16:43:20 -07:00
Maciej Borsz
422917b30b
Revert "Parallelize RC deletion in density test" 2018-08-24 09:47:09 +02:00
Kubernetes Submit Queue
f61040d0e1
Merge pull request #67769 from shyamjvs/remove-second-scaling-round-in-load-test
Automatic merge from submit-queue (batch tested with PRs 67748, 67769). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove second round of scaling in load test

As it seems redundant to do this twice, not really adding much value. This should cut down ~1.5h in our 5k-node load tests, and helps a bit with https://github.com/kubernetes/test-infra/issues/8348.

/cc @wojtek-t 

```release-note
NONE
```
2018-08-23 09:20:04 -07:00
Shyam Jeedigunta
2f7f6deef7 Re-calibrate load test throughputs 2018-08-23 17:37:06 +02:00
Shyam Jeedigunta
17f427d7b3 Remove second round of scaling in load test 2018-08-23 14:41:23 +02:00
Shyam Jeedigunta
c07ecad613 Parallelize RC deletion in density test 2018-08-22 16:30:01 +02:00
Maciej Borsz
2632a6a619 Scalability tests: Increase sample size for pod startup latency measurement. 2018-08-03 12:24:43 +02:00
Shyam Jeedigunta
7250a5621a Fix expected pod creations/deletions estimate in load test 2018-07-31 15:58:23 +02:00
tanshanshan
af0fc11ded error in return value should be tested 2018-07-30 15:17:32 +08:00
Maciej Borsz
9df9c2e506 Modify resource constraints for master components.
The growth is caused by increasing --kube-api-qps in kube-scheduler.
2018-07-13 16:46:57 +02:00
Kubernetes Submit Queue
a8777c26fa
Merge pull request #64695 from krzysied/etcd_metrics
Automatic merge from submit-queue (batch tested with PRs 64695, 65982, 65908). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Collecting etcd metrics

**What this PR does / why we need it**:
Adding etcd metrics to performance test log.

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
ref #64030

**Special notes for your reviewer**:

**Release note**:

```release-note
NONE
```
2018-07-10 08:55:03 -07:00
Wojciech Tyczynski
9340bca14e
Revert "Make no. of services in load test configurable" 2018-06-29 11:33:14 +02:00
Jeff Grafton
23ceebac22 Run hack/update-bazel.sh 2018-06-22 16:22:57 -07:00
Kubernetes Submit Queue
5880db4a65
Merge pull request #65335 from shyamjvs/add-scheduler-profiling-to-testing
Automatic merge from submit-queue (batch tested with PRs 65339, 65343, 65324, 65335, 65367). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Introduce scheduler CPU/Memory profile-gathering in density test

This should help us get more reliable/realistic data for scheduler (from our real-cluster scalability tests).

/cc @wojtek-t 
fyi - @davidopp @bsalamat @misterikkit 

```release-note
NONE
```
2018-06-22 10:31:20 -07:00
Shyam Jeedigunta
0c787703f5 Introduce scheduler CPU/Memory profile-gathering in density test 2018-06-22 12:12:05 +02:00
Shyam Jeedigunta
457548ef7d Refactor profile-gatherer to work across all master components 2018-06-22 12:11:56 +02:00
Shyam Jeedigunta
a01dea5df0 Make no. of services in load test configurable 2018-06-19 14:23:04 +02:00
Shyam Jeedigunta
3768d8a9a3 Half the no. of endpoints in load test 2018-06-18 14:59:45 +02:00
Kubernetes Submit Queue
65a5e68147
Merge pull request #64521 from shyamjvs/compute-scheduler-throughput-avg
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Compute avg and quantiles of scheduler throughput in density test

Based on my comment here - https://github.com/kubernetes/kubernetes/pull/64266#issuecomment-393189953

/sig scheduling
/kind cleanup
/priority important-soon
/milestone v1.11
/cc @wojtek-t 

```release-note
NONE
```
2018-06-13 14:23:51 -07:00
Shyam Jeedigunta
979a8d73e1 Compute avg and quantiles of scheduler throughput in density test 2018-06-12 18:40:52 +02:00
Krzysztof Siedlecki
aa022310a4 Collecting etcd metrics 2018-06-04 16:23:08 +02:00
Kubernetes Submit Queue
a2d8636559
Merge pull request #64316 from krzysied/scheduling_latency_metric
Automatic merge from submit-queue (batch tested with PRs 63328, 64316, 64444, 64449, 64453). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Fixing scheduling latency metrics

**What this PR does / why we need it**:
Allows to measure and to display scheduling latency metrics during tests. Provides new functionality of resetting scheduler latency metrics.

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #63493

**Special notes for your reviewer**:
E2eSchedulingLatency, SchedulingAlgorithmLatency, BindingLatency are now available 
as subtypes of OperationLatency.

**Release note**:

```release-note
NONE
```
2018-05-30 08:42:16 -07:00
Krzysztof Siedlecki
0e833bfc83 Fixing scheduling latency metrics 2018-05-30 11:20:12 +02:00
Shyam Jeedigunta
9ea33c604c Fix bug with scheduler throughput variable pass-by-value 2018-05-28 13:23:37 +02:00
Kubernetes Submit Queue
5f578f3385
Merge pull request #63979 from soltysh/drop_reapers
Automatic merge from submit-queue (batch tested with PRs 63859, 63979). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Drop reapers

/assign @deads2k @juanvallejo 

**Release note**:
```release-note
kubectl delete does not use reapers for removing objects anymore, but relies on server-side GC entirely
```
2018-05-26 00:32:11 -07:00
Maciej Szulik
383872615d
Remove kubectl reapers 2018-05-25 22:18:05 +02:00
Shyam Jeedigunta
f363f549c0 Measure scheduler throughput in density test 2018-05-25 14:49:11 +02:00